Apr 13 18:37:17 devstack cinder-volume[72872]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 18:37:17 devstack cinder-volume[72872]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 18:37:17 devstack cinder-volume[72872]: we strongly recommend against using it for new projects.
Apr 13 18:37:17 devstack cinder-volume[72872]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 18:37:17 devstack cinder-volume[72872]: framework.  For more detail see
Apr 13 18:37:17 devstack cinder-volume[72872]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 18:37:17 devstack cinder-volume[72872]:   import eventlet  # noqa
Apr 13 18:37:19 devstack cinder-volume[72872]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 18:37:19 devstack cinder-volume[72872]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 18:37:19 devstack cinder-volume[72872]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 18:37:19 devstack cinder-volume[72872]: INFO dbcounter [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Registered counter for database cinder
Apr 13 18:37:19 devstack cinder-volume[72872]: DEBUG oslo_db.sqlalchemy.engines [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:37:19 devstack cinder-volume[72872]: DEBUG dbcounter [-] [72872] Writer thread running {{(pid=72872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 18:37:19 devstack cinder-volume[72872]: INFO cinder.rpc [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 18:37:19 devstack cinder-volume[72872]: INFO cinder.rpc [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 18:37:19 devstack cinder-volume[72872]: DEBUG oslo_db.sqlalchemy.engines [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:37:19 devstack cinder-volume[72872]: INFO cinder.volume.manager [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Determined volume DB was empty at startup.
Apr 13 18:37:19 devstack cinder-volume[72872]: DEBUG cinder.volume.manager [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72872) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 18:37:19 devstack cinder-volume[72872]: INFO cinder.volume.manager [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 13 18:37:19 devstack cinder-volume[72872]: WARNING stevedore.named [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 18:37:19 devstack cinder-volume[72872]: WARNING castellan.key_manager [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 18:37:19 devstack cinder-volume[72872]: WARNING cinder.keymgr.conf_key_mgr [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 18:37:19 devstack cinder-volume[72872]: DEBUG cinder.volume.drivers.lvm [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72872) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 13 18:37:19 devstack cinder-volume[72872]: DEBUG oslo_concurrency.processutils [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_concurrency.processutils [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.244s {{(pid=72872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_db.sqlalchemy.engines [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:37:20 devstack cinder-volume[72872]: INFO cinder.rpc [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 13 18:37:20 devstack cinder-volume[72872]: INFO cinder.rpc [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 13 18:37:20 devstack cinder-volume[72872]: WARNING stevedore.named [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 18:37:20 devstack cinder-volume[72872]: WARNING castellan.key_manager [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 18:37:20 devstack cinder-volume[72872]: INFO cinder.volume.manager [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_db.sqlalchemy.engines [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:37:20 devstack cinder-volume[72872]: INFO oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Starting 1 workers
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Started child 72974 {{(pid=72872) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Full set of CONF: {{(pid=72872) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] ******************************************************************************** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Configuration options gathered from: {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] ================================================================================ {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] allow_availability_zone_fallback = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] allow_compression_on_image_upload = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] allowed_direct_url_schemes     = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] api_rate_limit                 = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] auth_strategy                  = keystone {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] az_cache_duration              = 3600 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72974]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_availability_zone      = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_host                   = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_name                   = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_stats_polling_interval = 60 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backup_api_class               = cinder.backup.api.API {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backup_name_template           = backup-%s {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backup_use_same_host           = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backup_use_temp_snapshot       = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] chap_password                  = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] chap_username                  =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cinder_internal_tenant_project_id = 2d88894650e94bab84b7515b010aefb5 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cinder_internal_tenant_user_id = 30a45d2166f0432fb41339b4fd98863c {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cloned_volume_same_az          = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cluster                        = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] compression_format             = gzip {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] config_dir                     = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] config_source                  = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] control_exchange               = openstack {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] debug                          = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] default_availability_zone      = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] default_group_type             = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] default_volume_type            = lvmdriver-1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] disk_geometry                  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] driver_client_cert             = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] driver_client_cert_key         = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] driver_data_namespace          = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] driver_ssl_cert_path           = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] driver_ssl_cert_verify         = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] driver_use_ssl                 = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] enable_force_upload            = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] enable_new_services            = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] enable_unsupported_driver      = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] enforce_multipath_for_image_xfer = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] filter_function                = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_api_insecure            = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_api_servers             = ['http://192.168.122.251/image'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_api_ssl_compression     = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_ca_certificates_file    = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_certfile                = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_keyfile                 = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_num_retries             = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance_request_timeout         = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] goodness_function              = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] graceful_shutdown_timeout      = 5 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] group_api_class                = cinder.group.api.API {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] host                           = devstack {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_compress_on_upload       = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_conversion_address_space_limit = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_conversion_cpu_limit     = 60 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_conversion_disable       = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_upload_use_cinder_backend = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_upload_use_internal_tenant = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_volume_cache_enabled     = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_volume_cache_max_count   = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] image_volume_cache_max_size_gb = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] init_host_max_objects_retrieval = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] iscsi_target_flags             =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] iscsi_write_cache              = on {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] iser_helper                    = tgtadm {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] iser_ip_address                = 192.168.122.251 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] iser_port                      = 3260 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] log_color                      = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] log_config_append              = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] log_dir                        = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] log_file                       = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] log_options                    = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] log_rotate_interval            = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] log_rotate_interval_type       = days {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] log_rotation_type              = none {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] max_age                        = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] max_logfile_count              = 30 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] max_logfile_size_mb            = 200 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] max_over_subscription_ratio    = 20.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] message_reap_interval          = 86400 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] message_ttl                    = 2592000 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] migration_create_volume_timeout_secs = 300 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] monkey_patch                   = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] monkey_patch_modules           = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] my_ip                          = 192.168.122.251 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] no_snapshot_gb_quota           = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] num_iser_scan_tries            = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] num_shell_tries                = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] num_volume_device_scan_tries   = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] nvmeof_conn_info_version       = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] nvmet_ns_id                    = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] nvmet_port_id                  = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] osapi_max_limit                = 1000 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] osapi_volume_ext_list          = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] osapi_volume_listen_port       = 8776 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] osapi_volume_use_ssl           = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] osapi_volume_workers           = 2 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] per_volume_size_limit          = -1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] periodic_fuzzy_delay           = 60 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] periodic_interval              = 60 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] public_endpoint                = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] publish_errors                 = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] quota_backup_gigabytes         = 1000 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] quota_backups                  = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] quota_gigabytes                = 1000 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] quota_groups                   = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] quota_snapshots                = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] quota_volumes                  = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] rate_limit_burst               = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] rate_limit_except_level        = CRITICAL {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] rate_limit_interval            = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] reinit_driver_count            = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] replication_device             = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] report_discard_supported       = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] report_interval                = 120 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] reservation_clean_interval     = 86400 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] reservation_expire             = 86400 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] reserved_image_namespaces      = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] reserved_percentage            = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] rpc_response_timeout           = 120 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] run_external_periodic_tasks    = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] scst_target_driver             = iscsi {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] scst_target_iqn_name           = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_down_time              = 720 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] shell_completion               = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] snapshot_name_template         = snapshot-%s {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] snapshot_same_host             = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] split_loggers                  = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] state_path                     = /opt/stack/data/cinder {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] storage_availability_zone      = nova {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] storage_protocol               = iSCSI {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] syslog_log_facility            = LOG_USER {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] target_helper                  = lioadm {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] target_ip_address              = 192.168.122.251 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] target_port                    = 3260 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] target_protocol                = iscsi {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] target_secondary_ip_addresses  = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] trace_flags                    = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] transport_url                  = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] until_refresh                  = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] use_chap_auth                  = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] use_default_quota_class        = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] use_journal                    = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] use_json                       = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] use_multipath_for_image_xfer   = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] use_stderr                     = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] use_syslog                     = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] verify_glance_signatures       = enabled {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_api_class               = cinder.volume.api.API {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_backend_name            = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_clear                   = zero {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_clear_ionice            = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_clear_size              = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_copy_bps_limit          = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_dd_blocksize            = 1M {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_name_template           = volume-%s {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_service_inithost_offload = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volume_usage_audit_period      = month {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72974]: INFO cinder.volume.manager [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] zoning_mode                    = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_concurrency.disable_process_locking = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.admin_password = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.admin_token = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.admin_user  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.auth_protocol = https {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.auth_section = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.auth_type   = password {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.auth_uri    = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.auth_version = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.cache       = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.certfile    = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.identity_uri = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.include_service_catalog = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.insecure    = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.interface   = public {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.keyfile     = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_password =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcache_username =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.region_name = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.service_type = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.backend                  = dogpile.cache.null {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.backend_argument         = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.backend_expiration_time  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.config_prefix            = cache.oslo {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.debug_cache_backend      = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.enable_retry_client      = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.enable_socket_keepalive  = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.enabled                  = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.enforce_fips_mode        = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.expiration_time          = 600 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.hashclient_retry_attempts = 2 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.memcache_dead_retry      = 300 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.memcache_sasl_enabled    = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.password                 = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.proxies                  = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.redis_db                 = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.redis_server             = localhost:6379 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.retry_attempts           = 2 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.retry_delay              = 0.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.socket_keepalive_count   = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.socket_keepalive_idle    = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.socket_keepalive_interval = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.socket_timeout           = 1.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.tls_allowed_ciphers      = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.tls_cafile               = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.tls_certfile             = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.tls_enabled              = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.tls_keyfile              = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cache.username                 = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] coordination.backend_url       = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.asyncio_connection    = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.asyncio_slave_connection = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.backend               = sqlalchemy {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.connection            = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.connection_debug      = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.connection_parameters =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.connection_recycle_time = 3600 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.connection_trace      = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.db_inc_retry_interval = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.db_max_retries        = 20 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.db_max_retry_interval = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.db_retry_interval     = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.max_overflow          = 50 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.max_pool_size         = 5 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.max_retries           = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.mysql_wsrep_sync_wait = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.pool_timeout          = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.retry_interval        = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.slave_connection      = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.sqlite_synchronous    = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.synchronous_reader    = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] database.use_db_reconnect      = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.connection_string     = messaging:// {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.enabled               = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.es_doc_type           = notification {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.es_scroll_size        = 10000 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.es_scroll_time        = 2m {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.filter_error_trace    = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.hmac_keys             = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.sentinel_service_name = mymaster {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.socket_timeout        = 0.1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.trace_requests        = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler.trace_sqlalchemy      = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler_jaeger.process_tags   = {} {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler_jaeger.service_name_prefix = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] profiler_otlp.service_name_prefix = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.enforce_new_defaults = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: WARNING oslo_config.cfg [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.enforce_scope      = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.policy_default_rule = default {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] privsep_osbrick.group          = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] privsep_osbrick.helper_command = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] privsep_osbrick.user           = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cinder_sys_admin.group         = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cinder_sys_admin.helper_command = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] cinder_sys_admin.user          = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.auth_section      = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.auth_type         = password {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.cafile            = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.certfile          = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.collect_timing    = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.insecure          = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.keyfile           = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.send_service_user_token = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.split_loggers     = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] service_user.timeout           = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.auth_section            = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.auth_type               = password {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.certfile                = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.collect_timing          = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.insecure                = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.keyfile                 = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.region_name             = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.split_loggers           = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] glance.timeout                 = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.backend_availability_zone = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.chap_password = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.chap_username =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.disk_geometry = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.driver_client_cert = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.driver_client_cert_key = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.driver_data_namespace = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.driver_use_ssl = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.extra_capabilities = {} {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.filter_function = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.goodness_function = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.iscsi_target_flags =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.iscsi_write_cache = on {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.iser_port     = 3260 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.lvm_share_target = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.lvm_type      = auto {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.num_shell_tries = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.replication_device = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.report_discard_supported = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.reserved_percentage = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.target_helper = tgtadm {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.target_port   = 3260 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.target_protocol = iscsi {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.trace_flags   = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.unique_fqdn_network = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.use_chap_auth = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volume_backend_name = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volume_clear  = zero {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volume_clear_ionice = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volume_clear_size = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_reports.file_event_handler = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_reports.log_dir           = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.backend_host       = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.chap_password      = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.chap_username      = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.disk_geometry      = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.driver_client_cert = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.extra_capabilities = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.filter_function    = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.goodness_function  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.iser_helper        = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.iser_port          = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.lvm_type           = auto {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.replication_device = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.report_discard_supported = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.reserved_percentage = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.scst_target_driver = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.storage_protocol   = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.target_ip_address  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.target_port        = 3260 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.trace_flags        = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volume_clear       = zero {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] lvmdriver-1.volumes_dir        = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_notifications.driver = [] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_notifications.retry = -1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] key_manager.fixed_key          = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.barbican_api_version  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.barbican_endpoint     = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.barbican_endpoint_type = public {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.barbican_region_name  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.cafile                = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.certfile              = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.collect_timing        = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.insecure              = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.keyfile               = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.number_of_retries     = 60 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.retry_delay           = 1 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.send_service_user_token = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.split_loggers         = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.timeout               = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.verify_ssl            = True {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican.verify_ssl_path       = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican_service_user.auth_section = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican_service_user.auth_type = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican_service_user.cafile   = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican_service_user.certfile = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican_service_user.collect_timing = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican_service_user.insecure = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack sudo[72978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 13 18:37:20 devstack sudo[72978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican_service_user.keyfile  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican_service_user.split_loggers = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] barbican_service_user.timeout  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.approle_role_id          = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.approle_secret_id        = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.kv_mountpoint            = secret {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.kv_path                  = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.kv_version               = 2 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.namespace                = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.root_token_id            = **** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.ssl_ca_crt_file          = None {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.timeout                  = 60.0 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.use_ssl                  = False {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:37:20 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] ******************************************************************************** {{(pid=72872) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 18:37:20 devstack sudo[72978]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:20 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.567s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:20 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:20 devstack sudo[72988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:37:20 devstack sudo[72988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:21 devstack sudo[72988]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:21 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.482s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:21 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:37:21 devstack cinder-volume[72974]: INFO cinder.brick.local_dev.lvm [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 13 18:37:21 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:21 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:21 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:21 devstack sudo[73187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 18:37:21 devstack sudo[73187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:21 devstack sudo[73187]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:21 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:21 devstack cinder-volume[72974]: DEBUG cinder.brick.local_dev.lvm [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72974) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 13 18:37:21 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:21 devstack sudo[73398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:37:21 devstack sudo[73398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:22 devstack sudo[73398]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:22 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.835s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:22 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:22 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:22 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:22 devstack sudo[73579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:37:22 devstack sudo[73579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:23 devstack sudo[73579]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:23 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.531s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:23 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:23 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:23 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:23 devstack sudo[73672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 13 18:37:23 devstack sudo[73672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:23 devstack sudo[73672]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:23 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.433s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:23 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:23 devstack sudo[73675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 18:37:23 devstack sudo[73675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:24 devstack sudo[73675]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:24 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:24 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:24 devstack sudo[73678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 18:37:24 devstack sudo[73678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:24 devstack sudo[73678]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:24 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:24 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:24 devstack sudo[73683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:37:24 devstack sudo[73683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:25 devstack sudo[73683]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:25 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:25 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:25 devstack sudo[73689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:37:25 devstack sudo[73689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:25 devstack sudo[73689]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:25 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:25 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:25 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:25 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:25 devstack sudo[73695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:37:25 devstack sudo[73695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:26 devstack sudo[73695]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:26 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:26 devstack cinder-volume[72974]: INFO cinder.volume.drivers.lvm [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 13 18:37:26 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:26 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:26 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:26 devstack sudo[73700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:37:26 devstack sudo[73700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:26 devstack sudo[73700]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:26 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:26 devstack cinder-volume[72974]: DEBUG cinder.volume.drivers.lvm [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Updating volume stats {{(pid=72974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 18:37:26 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:26 devstack sudo[73744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 18:37:26 devstack sudo[73744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:27 devstack sudo[73744]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:27 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:27 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:27 devstack sudo[73825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:37:27 devstack sudo[73825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:27 devstack sudo[73825]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:27 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:27 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:27 devstack sudo[73930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:37:27 devstack sudo[73930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:28 devstack sudo[73930]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.435s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:28 devstack sudo[73967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:37:28 devstack sudo[73967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:28 devstack sudo[73967]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:28 devstack cinder-volume[72974]: INFO cinder.volume.driver [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG cinder.volume.driver [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72974) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG oslo_db.sqlalchemy.engines [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG dbcounter [-] [72974] Writer thread running {{(pid=72974) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG cinder.db.sqlalchemy.api [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Building query based on filter {{(pid=72974) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG cinder.image.image_utils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72974) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 18:37:28 devstack cinder-volume[72974]: INFO cinder.keymgr.migration [None req-79df00fd-0cfe-46db-8511-44e13314ff48 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG cinder.volume.drivers.lvm [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Updating volume stats {{(pid=72974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 18:37:28 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:28 devstack sudo[73971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 18:37:28 devstack sudo[73971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:29 devstack sudo[73971]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:29 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:29 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:29 devstack sudo[73978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:37:29 devstack sudo[73978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:29 devstack sudo[73978]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:29 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:29 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:29 devstack sudo[73981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:37:29 devstack sudo[73981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:29 devstack sudo[73981]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:29 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:29 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:29 devstack sudo[73984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:37:29 devstack sudo[73984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:30 devstack cinder-volume[72872]: DEBUG dbcounter [-] [72872] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:37:30 devstack sudo[73984]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:30 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:30 devstack cinder-volume[72974]: DEBUG cinder.manager [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Notifying Schedulers of capabilities ... {{(pid=72974) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:37:30 devstack cinder-volume[72974]: INFO cinder.volume.manager [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Driver initialization completed successfully.
Apr 13 18:37:30 devstack cinder-volume[72974]: INFO cinder.manager [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Initiating service 2 cleanup
Apr 13 18:37:30 devstack cinder-volume[72974]: INFO cinder.manager [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Service 2 cleanup completed.
Apr 13 18:37:30 devstack cinder-volume[72974]: DEBUG cinder.service [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Creating RPC server for service cinder-volume {{(pid=72974) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 18:37:30 devstack cinder-volume[72974]: DEBUG cinder.service [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72974) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 18:37:30 devstack cinder-volume[72974]: INFO cinder.volume.manager [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 13 18:37:30 devstack cinder-volume[72974]: DEBUG cinder.volume.drivers.lvm [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Updating volume stats {{(pid=72974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 18:37:30 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:30 devstack sudo[73990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 18:37:30 devstack sudo[73990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:31 devstack sudo[73990]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:31 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:31 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:31 devstack sudo[73998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:37:31 devstack sudo[73998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:31 devstack sudo[73998]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:31 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:31 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:31 devstack sudo[74001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:37:31 devstack sudo[74001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:31 devstack sudo[74001]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:31 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.435s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:31 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:37:31 devstack sudo[74058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:37:31 devstack sudo[74058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:37:32 devstack sudo[74058]: pam_unix(sudo:session): session closed for user root
Apr 13 18:37:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:37:32 devstack cinder-volume[72974]: INFO cinder.volume.manager [None req-9585aa4a-ea1d-4192-bad8-a2ac642fefda None None] Driver post RPC initialization completed successfully.
Apr 13 18:37:42 devstack cinder-volume[72974]: DEBUG dbcounter [-] [72974] Writing DB stats cinder:SELECT=5 {{(pid=72974) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:37:42 devstack cinder-volume[72974]: DEBUG dbcounter [-] [72974] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72974) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:38:32 devstack cinder-volume[72974]: DEBUG oslo_service.periodic_task [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72974) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:38:32 devstack cinder-volume[72974]: DEBUG cinder.volume.drivers.lvm [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Updating volume stats {{(pid=72974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 18:38:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:38:32 devstack sudo[78789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 18:38:32 devstack sudo[78789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:38:32 devstack sudo[78789]: pam_unix(sudo:session): session closed for user root
Apr 13 18:38:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:38:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:38:32 devstack sudo[78792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:38:32 devstack sudo[78792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:38:33 devstack sudo[78792]: pam_unix(sudo:session): session closed for user root
Apr 13 18:38:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:38:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:38:33 devstack sudo[78796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:38:33 devstack sudo[78796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:38:33 devstack sudo[78796]: pam_unix(sudo:session): session closed for user root
Apr 13 18:38:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:38:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:38:33 devstack sudo[78800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:38:33 devstack sudo[78800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:38:34 devstack sudo[78800]: pam_unix(sudo:session): session closed for user root
Apr 13 18:38:34 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:38:34 devstack cinder-volume[72974]: DEBUG cinder.manager [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Notifying Schedulers of capabilities ... {{(pid=72974) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:39:32 devstack cinder-volume[72974]: DEBUG oslo_service.periodic_task [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72974) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:39:32 devstack cinder-volume[72974]: DEBUG cinder.volume.drivers.lvm [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Updating volume stats {{(pid=72974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 18:39:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:39:32 devstack sudo[79860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 18:39:32 devstack sudo[79860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:39:32 devstack sudo[79860]: pam_unix(sudo:session): session closed for user root
Apr 13 18:39:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:39:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:39:32 devstack sudo[79924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:39:32 devstack sudo[79924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:39:33 devstack sudo[79924]: pam_unix(sudo:session): session closed for user root
Apr 13 18:39:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:39:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:39:33 devstack sudo[79941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:39:33 devstack sudo[79941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:39:33 devstack sudo[79941]: pam_unix(sudo:session): session closed for user root
Apr 13 18:39:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:39:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:39:33 devstack sudo[79960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:39:33 devstack sudo[79960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:39:34 devstack sudo[79960]: pam_unix(sudo:session): session closed for user root
Apr 13 18:39:34 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:39:34 devstack cinder-volume[72974]: DEBUG cinder.manager [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Notifying Schedulers of capabilities ... {{(pid=72974) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:39:42 devstack cinder-volume[72974]: DEBUG dbcounter [-] [72974] Writing DB stats cinder:SELECT=1 {{(pid=72974) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:39:42 devstack cinder-volume[72974]: DEBUG dbcounter [-] [72974] Writing DB stats cinder:UPDATE=1 {{(pid=72974) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:40:32 devstack cinder-volume[72974]: DEBUG oslo_service.periodic_task [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72974) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:40:32 devstack cinder-volume[72974]: DEBUG cinder.volume.drivers.lvm [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Updating volume stats {{(pid=72974) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 18:40:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:40:32 devstack sudo[81561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 18:40:32 devstack sudo[81561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:40:32 devstack sudo[81561]: pam_unix(sudo:session): session closed for user root
Apr 13 18:40:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:40:32 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:40:32 devstack sudo[81574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:40:32 devstack sudo[81574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:40:33 devstack sudo[81574]: pam_unix(sudo:session): session closed for user root
Apr 13 18:40:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:40:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:40:33 devstack sudo[81638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 18:40:33 devstack sudo[81638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:40:33 devstack sudo[81638]: pam_unix(sudo:session): session closed for user root
Apr 13 18:40:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:40:33 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:40:33 devstack sudo[81648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 18:40:33 devstack sudo[81648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:40:34 devstack sudo[81648]: pam_unix(sudo:session): session closed for user root
Apr 13 18:40:34 devstack cinder-volume[72974]: DEBUG oslo_concurrency.processutils [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=72974) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:40:34 devstack cinder-volume[72974]: DEBUG cinder.manager [None req-284df867-6da3-4f05-bc75-1abe7ec0e227 None None] Notifying Schedulers of capabilities ... {{(pid=72974) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:40:46 devstack cinder-volume[72872]: INFO oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Caught SIGTERM, stopping children
Apr 13 18:40:46 devstack cinder-volume[72872]: DEBUG oslo_concurrency.lockutils [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Acquiring lock "singleton_lock" {{(pid=72872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 18:40:46 devstack cinder-volume[72872]: DEBUG oslo_concurrency.lockutils [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Acquired lock "singleton_lock" {{(pid=72872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 18:40:46 devstack cinder-volume[72872]: DEBUG oslo_concurrency.lockutils [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Releasing lock "singleton_lock" {{(pid=72872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 18:40:46 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Stop services. {{(pid=72872) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 13 18:40:46 devstack cinder-volume[72872]: DEBUG oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Killing children. {{(pid=72872) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 13 18:40:46 devstack cinder-volume[72872]: INFO oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Waiting on 1 children to exit
Apr 13 18:40:50 devstack cinder-volume[72974]: DEBUG oslo_concurrency.lockutils [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Acquiring lock "singleton_lock" {{(pid=72974) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 18:40:50 devstack cinder-volume[72974]: DEBUG oslo_concurrency.lockutils [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Acquired lock "singleton_lock" {{(pid=72974) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 18:40:50 devstack cinder-volume[72974]: DEBUG oslo_concurrency.lockutils [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Releasing lock "singleton_lock" {{(pid=72974) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 18:40:50 devstack cinder-volume[72974]: WARNING amqp [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 18:40:50 devstack cinder-volume[72974]: WARNING amqp [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 18:40:50 devstack cinder-volume[72872]: INFO oslo_service.backend._eventlet.service [None req-fd82b46e-1000-4426-bc86-794f6588aad9 None None] Child 72974 exited with status 0
Apr 13 18:40:50 devstack cinder-volume[82031]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 18:40:50 devstack cinder-volume[82031]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 18:40:50 devstack cinder-volume[82031]: we strongly recommend against using it for new projects.
Apr 13 18:40:50 devstack cinder-volume[82031]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 18:40:50 devstack cinder-volume[82031]: framework.  For more detail see
Apr 13 18:40:50 devstack cinder-volume[82031]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 18:40:50 devstack cinder-volume[82031]:   import eventlet  # noqa
Apr 13 18:40:52 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 18:40:52 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 18:40:52 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 18:40:53 devstack cinder-volume[82031]: INFO dbcounter [None req-27686590-ad81-4638-bbce-d866e580372f None None] Registered counter for database cinder
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-27686590-ad81-4638-bbce-d866e580372f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG dbcounter [-] [82031] Writer thread running {{(pid=82031) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 18:40:53 devstack cinder-volume[82031]: INFO cinder.rpc [None req-27686590-ad81-4638-bbce-d866e580372f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 18:40:53 devstack cinder-volume[82031]: INFO cinder.rpc [None req-27686590-ad81-4638-bbce-d866e580372f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-27686590-ad81-4638-bbce-d866e580372f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:40:53 devstack cinder-volume[82031]: INFO cinder.volume.manager [None req-27686590-ad81-4638-bbce-d866e580372f None None] Determined volume DB was empty at startup.
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG cinder.volume.manager [None req-27686590-ad81-4638-bbce-d866e580372f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82031) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 18:40:53 devstack cinder-volume[82031]: INFO cinder.volume.manager [None req-27686590-ad81-4638-bbce-d866e580372f None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 13 18:40:53 devstack cinder-volume[82031]: WARNING stevedore.named [None req-27686590-ad81-4638-bbce-d866e580372f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 18:40:53 devstack cinder-volume[82031]: WARNING castellan.key_manager [None req-27686590-ad81-4638-bbce-d866e580372f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 18:40:53 devstack cinder-volume[82031]: WARNING cinder.keymgr.conf_key_mgr [None req-27686590-ad81-4638-bbce-d866e580372f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 18:40:53 devstack cinder-volume[82031]: INFO cinder.volume.manager [None req-27686590-ad81-4638-bbce-d866e580372f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-27686590-ad81-4638-bbce-d866e580372f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:40:53 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] Starting 1 workers
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] Started child 82150 {{(pid=82031) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] Full set of CONF: {{(pid=82031) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] ******************************************************************************** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] Configuration options gathered from: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 18:40:53 devstack cinder-volume[82150]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] ================================================================================ {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] allow_availability_zone_fallback = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] allow_compression_on_image_upload = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] allowed_direct_url_schemes     = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] api_rate_limit                 = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] auth_strategy                  = keystone {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_availability_zone      = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_host                   = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_name                   = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_stats_polling_interval = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backup_api_class               = cinder.backup.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backup_name_template           = backup-%s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backup_use_same_host           = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backup_use_temp_snapshot       = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] chap_password                  = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] chap_username                  =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cinder_internal_tenant_project_id = 2d88894650e94bab84b7515b010aefb5 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cinder_internal_tenant_user_id = 30a45d2166f0432fb41339b4fd98863c {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cluster                        = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] compression_format             = gzip {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] compute_api_class              = cinder.compute.nova.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] config_dir                     = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] config_source                  = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] control_exchange               = openstack {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] debug                          = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] default_availability_zone      = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] default_group_type             = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] default_volume_type            = QuobyteHD {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] disk_geometry                  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] driver_client_cert             = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] driver_client_cert_key         = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] driver_data_namespace          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] driver_ssl_cert_path           = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] driver_ssl_cert_verify         = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] driver_use_ssl                 = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] enable_new_services            = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] enable_unsupported_driver      = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] enabled_backends               = ['QuobyteHD'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] enforce_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] filter_function                = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_api_insecure            = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_api_servers             = ['http://192.168.122.251/image'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_api_ssl_compression     = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_ca_certificates_file    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_catalog_info            = image:glance:publicURL {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82150]: INFO cinder.volume.manager [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_certfile                = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_keyfile                 = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_num_retries             = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance_request_timeout         = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82150]: DEBUG cinder.volume.drivers.remotefs [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82150) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] goodness_function              = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] graceful_shutdown_timeout      = 5 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] group_api_class                = cinder.group.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] host                           = devstack {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_compress_on_upload       = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_conversion_address_space_limit = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_conversion_cpu_limit     = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_conversion_disable       = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_upload_use_cinder_backend = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_upload_use_internal_tenant = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_volume_cache_enabled     = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_volume_cache_max_count   = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] image_volume_cache_max_size_gb = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] init_host_max_objects_retrieval = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] instance_format                = [instance: %(uuid)s]  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] iscsi_target_flags             =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] iscsi_write_cache              = on {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] iser_helper                    = tgtadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] iser_ip_address                = 192.168.122.251 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] iser_port                      = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] log_color                      = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] log_config_append              = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] log_dir                        = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] log_file                       = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] log_options                    = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] log_rotate_interval            = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] log_rotate_interval_type       = days {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] log_rotation_type              = none {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] max_age                        = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] max_logfile_count              = 30 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] max_logfile_size_mb            = 200 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] max_over_subscription_ratio    = 20.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] message_reap_interval          = 86400 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] message_ttl                    = 2592000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] migration_create_volume_timeout_secs = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] monkey_patch                   = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] monkey_patch_modules           = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] my_ip                          = 192.168.122.251 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] no_snapshot_gb_quota           = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] num_iser_scan_tries            = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] num_shell_tries                = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] num_volume_device_scan_tries   = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] nvmeof_conn_info_version       = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] nvmet_ns_id                    = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] nvmet_port_id                  = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] osapi_max_limit                = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] osapi_volume_ext_list          = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] osapi_volume_listen_port       = 8776 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] osapi_volume_use_ssl           = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] osapi_volume_workers           = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] per_volume_size_limit          = -1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] periodic_fuzzy_delay           = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] periodic_interval              = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] public_endpoint                = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] publish_errors                 = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] quota_backup_gigabytes         = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] quota_backups                  = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] quota_gigabytes                = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] quota_groups                   = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] quota_snapshots                = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] quota_volumes                  = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] rate_limit_burst               = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] rate_limit_except_level        = CRITICAL {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] rate_limit_interval            = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] reinit_driver_count            = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] replication_device             = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] report_discard_supported       = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] report_interval                = 120 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] reservation_clean_interval     = 86400 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] reservation_expire             = 86400 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] reserved_image_namespaces      = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] reserved_percentage            = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] rpc_response_timeout           = 120 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] run_external_periodic_tasks    = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] scst_target_driver             = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] scst_target_iqn_name           = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_down_time              = 720 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] shell_completion               = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] snapshot_name_template         = snapshot-%s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] split_loggers                  = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] state_path                     = /opt/stack/data/cinder {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] storage_availability_zone      = nova {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82150]: DEBUG cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82150) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 13 18:40:53 devstack cinder-volume[82150]: WARNING cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 13 18:40:53 devstack cinder-volume[82150]: WARNING cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] storage_protocol               = iSCSI {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] syslog_log_facility            = LOG_USER {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] target_helper                  = lioadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Running cmd (subprocess): mount.quobyte {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] target_ip_address              = 192.168.122.251 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] target_port                    = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] target_protocol                = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] target_secondary_ip_addresses  = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] trace_flags                    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] transport_url                  = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] until_refresh                  = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] use_chap_auth                  = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] use_default_quota_class        = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] use_journal                    = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] use_json                       = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] use_multipath_for_image_xfer   = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] use_stderr                     = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] use_syslog                     = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] verify_glance_signatures       = enabled {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_api_class               = cinder.volume.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_backend_name            = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_clear                   = zero {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_clear_ionice            = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_clear_size              = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_copy_bps_limit          = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_dd_blocksize            = 1M {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_name_template           = volume-%s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_service_inithost_offload = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volume_usage_audit_period      = month {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] zoning_mode                    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_concurrency.disable_process_locking = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.admin_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.admin_token = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.admin_user  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.auth_port   = 35357 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.auth_protocol = https {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.auth_type   = password {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.auth_uri    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.auth_version = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.cache       = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.certfile    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.delay_auth_decision = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.http_connect_timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.identity_uri = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.include_service_catalog = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.insecure    = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.interface   = public {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.keyfile     = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_password =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcache_username =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.region_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.service_token_roles_required = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.service_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.token_cache_time = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.backend                  = dogpile.cache.null {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.backend_argument         = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.backend_expiration_time  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.config_prefix            = cache.oslo {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.debug_cache_backend      = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.enable_retry_client      = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.enable_socket_keepalive  = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.enabled                  = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.enforce_fips_mode        = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.expiration_time          = 600 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.hashclient_retry_attempts = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.memcache_dead_retry      = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.memcache_pool_maxsize    = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.memcache_sasl_enabled    = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.password                 = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.proxies                  = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.redis_db                 = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.redis_sentinel_service_name = mymaster {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.redis_server             = localhost:6379 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.retry_attempts           = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.retry_delay              = 0.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.socket_keepalive_count   = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.socket_keepalive_idle    = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.socket_keepalive_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.socket_timeout           = 1.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.tls_allowed_ciphers      = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.tls_cafile               = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.tls_certfile             = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.tls_enabled              = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.tls_keyfile              = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cache.username                 = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] coordination.backend_url       = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.asyncio_connection    = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.asyncio_slave_connection = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.backend               = sqlalchemy {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.connection            = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.connection_debug      = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack quobyte-client[82151]: Reading configuration file: /etc/quobyte/client.cfg
Apr 13 18:40:53 devstack quobyte-client[82151]: Invalid parameters found, error: missing mount point.
Apr 13 18:40:53 devstack quobyte-client[82151]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 13 18:40:53 devstack quobyte-client[82151]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.connection_parameters =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.connection_recycle_time = 3600 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.connection_trace      = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.db_inc_retry_interval = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.db_max_retries        = 20 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.db_max_retry_interval = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.db_retry_interval     = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.max_overflow          = 50 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.max_pool_size         = 5 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.max_retries           = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.mysql_wsrep_sync_wait = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.pool_timeout          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.retry_interval        = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.slave_connection      = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.sqlite_synchronous    = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.synchronous_reader    = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] database.use_db_reconnect      = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.connection_string     = messaging:// {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.enabled               = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.es_doc_type           = notification {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.es_scroll_size        = 10000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.es_scroll_time        = 2m {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.filter_error_trace    = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.hmac_keys             = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82150) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:40:53 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82150) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:40:53 devstack cinder-volume[82150]: DEBUG cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.sentinel_service_name = mymaster {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.socket_timeout        = 0.1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82150]: INFO cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f ...
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.trace_requests        = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded -c /etc/quobyte/client-cinder.cfg {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler.trace_sqlalchemy      = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler_jaeger.process_tags   = {} {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler_jaeger.service_name_prefix = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] profiler_otlp.service_name_prefix = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.enforce_new_defaults = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: WARNING oslo_config.cfg [None req-27686590-ad81-4638-bbce-d866e580372f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.enforce_scope      = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.policy_default_rule = default {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.policy_file        = policy.yaml {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] privsep_osbrick.group          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] privsep_osbrick.helper_command = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] privsep_osbrick.user           = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cinder_sys_admin.group         = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cinder_sys_admin.helper_command = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] cinder_sys_admin.user          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.auth_section      = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.auth_type         = password {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.cafile            = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.certfile          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.collect_timing    = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.insecure          = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.keyfile           = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.send_service_user_token = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack sudo[82152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded -c /etc/quobyte/client-cinder.cfg
Apr 13 18:40:53 devstack sudo[82152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.split_loggers     = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] service_user.timeout           = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.auth_section            = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.auth_type               = password {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.certfile                = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.collect_timing          = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.insecure                = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.keyfile                 = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.region_name             = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.split_loggers           = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] glance.timeout                 = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.backend_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.chap_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.chap_username =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.disk_geometry = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.driver_client_cert = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.driver_client_cert_key = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.driver_data_namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.driver_use_ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.enable_unsupported_driver = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.extra_capabilities = {} {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.filter_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.goodness_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.iscsi_target_flags =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.iscsi_write_cache = on {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.iser_helper   = tgtadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.iser_port     = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_host      =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_login     = admin {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_mount_options = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_password  = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_private_key =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_share_path =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.num_shell_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.nvmet_port_id = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.quobyte_client_cfg = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.quobyte_volume_url = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.replication_device = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.report_discard_supported = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.reserved_percentage = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.scst_target_driver = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.scst_target_iqn_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.storage_protocol = iSCSI {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.target_helper = tgtadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.target_port   = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.target_protocol = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.trace_flags   = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.unique_fqdn_network = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.use_chap_auth = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.volume_backend_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.volume_clear  = zero {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.volume_clear_ionice = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.volume_clear_size = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_reports.file_event_handler = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_reports.log_dir           = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.backend_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.backend_host         = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.chap_password        = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.chap_username        = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.chiscsi_conf         = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.disk_geometry        = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.driver_client_cert   = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.driver_client_cert_key = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.driver_data_namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.driver_use_ssl       = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.extra_capabilities   = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.filter_function      = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.goodness_function    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.iser_helper          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.iser_ip_address      = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.iser_port            = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.iser_target_prefix   = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_host             = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_login            = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_mount_options    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_password         = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_private_key      = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_share_path       = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_ssh_port         = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.num_shell_tries      = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.nvmet_port_id        = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.replication_device   = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.report_discard_supported = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.reserved_percentage  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.scst_target_driver   = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.storage_protocol     = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.target_helper        = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.target_ip_address    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.target_port          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.target_prefix        = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.target_protocol      = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.trace_flags          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.use_chap_auth        = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.volume_clear         = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.volume_clear_size    = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] QuobyteHD.volumes_dir          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.ssl      = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_notifications.driver = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_notifications.retry = -1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] oslo_messaging_notifications.transport_url = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] key_manager.fixed_key          = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.barbican_api_version  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.barbican_endpoint     = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.barbican_endpoint_type = public {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.barbican_region_name  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.cafile                = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.certfile              = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.collect_timing        = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.insecure              = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.keyfile               = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.number_of_retries     = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.retry_delay           = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.send_service_user_token = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.split_loggers         = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.timeout               = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.verify_ssl            = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican.verify_ssl_path       = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican_service_user.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican_service_user.auth_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican_service_user.cafile   = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican_service_user.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican_service_user.collect_timing = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican_service_user.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican_service_user.keyfile  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican_service_user.split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] barbican_service_user.timeout  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.approle_role_id          = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.approle_secret_id        = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.kv_mountpoint            = secret {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.kv_path                  = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.kv_version               = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.namespace                = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.root_token_id            = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.ssl_ca_crt_file          = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.timeout                  = 60.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.use_ssl                  = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:40:53 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] ******************************************************************************** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 18:40:54 devstack sudo[82152]: pam_unix(sudo:session): session closed for user root
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.515s {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:40:54 devstack cinder-volume[82150]: INFO cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f succeeded
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.522s {{(pid=82150) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:40:54 devstack sudo[82221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:40:54 devstack sudo[82221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:40:54 devstack sudo[82221]: pam_unix(sudo:session): session closed for user root
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.405s {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:40:54 devstack cinder-volume[82150]: INFO cinder.volume.driver [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG cinder.volume.driver [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7193908691406, 'free_capacity_gb': 1775.7193908691406, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82150) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG oslo_db.sqlalchemy.engines [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG dbcounter [-] [82150] Writer thread running {{(pid=82150) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG cinder.db.sqlalchemy.api [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Building query based on filter {{(pid=82150) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG cinder.image.image_utils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82150) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 18:40:54 devstack cinder-volume[82150]: INFO cinder.keymgr.migration [None req-bafaa332-8ac1-44ee-b416-7b96f1bab244 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82150) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82150) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82150) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:40:54 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:40:54 devstack sudo[82224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:40:54 devstack sudo[82224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:40:55 devstack sudo[82224]: pam_unix(sudo:session): session closed for user root
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.401s {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG cinder.manager [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Notifying Schedulers of capabilities ... {{(pid=82150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:40:55 devstack cinder-volume[82150]: INFO cinder.volume.manager [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Driver initialization completed successfully.
Apr 13 18:40:55 devstack cinder-volume[82150]: INFO cinder.manager [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Initiating service 3 cleanup
Apr 13 18:40:55 devstack cinder-volume[82150]: INFO cinder.manager [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Service 3 cleanup completed.
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG cinder.service [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Creating RPC server for service cinder-volume {{(pid=82150) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG cinder.service [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82150) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 18:40:55 devstack cinder-volume[82150]: INFO cinder.volume.manager [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82150) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82150) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG cinder.volume.drivers.quobyte [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82150) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:40:55 devstack sudo[82229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:40:55 devstack sudo[82229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:40:55 devstack sudo[82229]: pam_unix(sudo:session): session closed for user root
Apr 13 18:40:55 devstack cinder-volume[82150]: DEBUG oslo_concurrency.processutils [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.432s {{(pid=82150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:40:55 devstack cinder-volume[82150]: INFO cinder.volume.manager [None req-d2900c75-dceb-4a9f-84d8-6f2fe503a335 None None] Driver post RPC initialization completed successfully.
Apr 13 18:40:57 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] Caught SIGTERM, stopping children
Apr 13 18:40:57 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [None req-27686590-ad81-4638-bbce-d866e580372f None None] Acquiring lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 18:40:57 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [None req-27686590-ad81-4638-bbce-d866e580372f None None] Acquired lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 18:40:57 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [None req-27686590-ad81-4638-bbce-d866e580372f None None] Releasing lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 18:40:57 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] Stop services. {{(pid=82031) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 13 18:40:57 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] Killing children. {{(pid=82031) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 13 18:40:57 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] Waiting on 1 children to exit
Apr 13 18:40:59 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-27686590-ad81-4638-bbce-d866e580372f None None] Acquiring lock "singleton_lock" {{(pid=82150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 18:40:59 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-27686590-ad81-4638-bbce-d866e580372f None None] Acquired lock "singleton_lock" {{(pid=82150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 18:40:59 devstack cinder-volume[82150]: DEBUG oslo_concurrency.lockutils [None req-27686590-ad81-4638-bbce-d866e580372f None None] Releasing lock "singleton_lock" {{(pid=82150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 18:40:59 devstack cinder-volume[82150]: WARNING amqp [None req-27686590-ad81-4638-bbce-d866e580372f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 18:40:59 devstack cinder-volume[82150]: WARNING amqp [None req-27686590-ad81-4638-bbce-d866e580372f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 18:40:59 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-27686590-ad81-4638-bbce-d866e580372f None None] Child 82150 exited with status 0
Apr 13 18:40:59 devstack cinder-volume[82370]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 18:40:59 devstack cinder-volume[82370]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 18:40:59 devstack cinder-volume[82370]: we strongly recommend against using it for new projects.
Apr 13 18:40:59 devstack cinder-volume[82370]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 18:40:59 devstack cinder-volume[82370]: framework.  For more detail see
Apr 13 18:40:59 devstack cinder-volume[82370]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 18:40:59 devstack cinder-volume[82370]:   import eventlet  # noqa
Apr 13 18:41:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 18:41:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 18:41:01 devstack cinder-volume[82370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82370) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 18:41:01 devstack cinder-volume[82370]: INFO dbcounter [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Registered counter for database cinder
Apr 13 18:41:01 devstack cinder-volume[82370]: DEBUG oslo_db.sqlalchemy.engines [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writer thread running {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 18:41:02 devstack cinder-volume[82370]: INFO cinder.rpc [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 18:41:02 devstack cinder-volume[82370]: INFO cinder.rpc [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_db.sqlalchemy.engines [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:41:02 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Determined volume DB was empty at startup.
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG cinder.volume.manager [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82370) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 18:41:02 devstack cinder-volume[82370]: WARNING stevedore.named [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 18:41:02 devstack cinder-volume[82370]: WARNING castellan.key_manager [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 18:41:02 devstack cinder-volume[82370]: WARNING cinder.keymgr.conf_key_mgr [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 18:41:02 devstack cinder-volume[82370]: INFO cinder.volume.manager [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_db.sqlalchemy.engines [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:41:02 devstack cinder-volume[82370]: INFO oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Starting 1 workers
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Started child 82517 {{(pid=82370) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Full set of CONF: {{(pid=82370) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] ******************************************************************************** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Configuration options gathered from: {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] ================================================================================ {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] allow_availability_zone_fallback = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] allow_compression_on_image_upload = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] allowed_direct_url_schemes     = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] api_rate_limit                 = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] auth_strategy                  = keystone {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_availability_zone      = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_host                   = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_name                   = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_stats_polling_interval = 60 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backup_api_class               = cinder.backup.api.API {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backup_name_template           = backup-%s {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backup_use_same_host           = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backup_use_temp_snapshot       = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] chap_password                  = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] chap_username                  =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cinder_internal_tenant_project_id = 2d88894650e94bab84b7515b010aefb5 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cinder_internal_tenant_user_id = 30a45d2166f0432fb41339b4fd98863c {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cluster                        = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] compression_format             = gzip {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] compute_api_class              = cinder.compute.nova.API {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] config_dir                     = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82517]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] config_source                  = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] control_exchange               = openstack {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] debug                          = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] default_availability_zone      = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] default_group_type             = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] default_volume_type            = QuobyteHD {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] disk_geometry                  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] driver_client_cert             = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] driver_client_cert_key         = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] driver_data_namespace          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] driver_ssl_cert_path           = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] driver_ssl_cert_verify         = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] driver_use_ssl                 = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] enable_new_services            = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] enable_unsupported_driver      = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] enabled_backends               = ['QuobyteHD'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] enforce_multipath_for_image_xfer = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] filter_function                = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_api_insecure            = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_api_servers             = ['http://192.168.122.251/image'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_api_ssl_compression     = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_ca_certificates_file    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_catalog_info            = image:glance:publicURL {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_certfile                = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_keyfile                 = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_num_retries             = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance_request_timeout         = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] goodness_function              = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] graceful_shutdown_timeout      = 5 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] group_api_class                = cinder.group.api.API {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] host                           = devstack {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_compress_on_upload       = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_conversion_address_space_limit = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_conversion_cpu_limit     = 60 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_conversion_disable       = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_upload_use_cinder_backend = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_upload_use_internal_tenant = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_volume_cache_enabled     = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_volume_cache_max_count   = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] image_volume_cache_max_size_gb = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] init_host_max_objects_retrieval = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] instance_format                = [instance: %(uuid)s]  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] iscsi_target_flags             =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] iscsi_write_cache              = on {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] iser_helper                    = tgtadm {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] iser_ip_address                = 192.168.122.251 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] iser_port                      = 3260 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] log_color                      = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] log_config_append              = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] log_dir                        = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] log_file                       = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] log_options                    = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] log_rotate_interval            = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] log_rotate_interval_type       = days {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] log_rotation_type              = none {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] max_age                        = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] max_logfile_count              = 30 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] max_logfile_size_mb            = 200 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] max_over_subscription_ratio    = 20.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] message_reap_interval          = 86400 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] message_ttl                    = 2592000 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] migration_create_volume_timeout_secs = 300 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] monkey_patch                   = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] monkey_patch_modules           = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] my_ip                          = 192.168.122.251 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] no_snapshot_gb_quota           = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] num_iser_scan_tries            = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] num_shell_tries                = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] num_volume_device_scan_tries   = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] nvmeof_conn_info_version       = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] nvmet_ns_id                    = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] nvmet_port_id                  = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] osapi_max_limit                = 1000 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] osapi_volume_ext_list          = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82517) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] osapi_volume_listen_port       = 8776 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] osapi_volume_use_ssl           = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] osapi_volume_workers           = 2 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] per_volume_size_limit          = -1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] periodic_fuzzy_delay           = 60 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] periodic_interval              = 60 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] public_endpoint                = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] publish_errors                 = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] quota_backup_gigabytes         = 1000 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] quota_backups                  = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] quota_gigabytes                = 1000 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] quota_groups                   = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] quota_snapshots                = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] quota_volumes                  = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] rate_limit_burst               = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] rate_limit_except_level        = CRITICAL {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] rate_limit_interval            = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] reinit_driver_count            = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] replication_device             = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] report_discard_supported       = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] report_interval                = 120 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] reservation_clean_interval     = 86400 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] reservation_expire             = 86400 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] reserved_image_namespaces      = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] reserved_percentage            = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] rpc_response_timeout           = 120 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] run_external_periodic_tasks    = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] scst_target_driver             = iscsi {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] scst_target_iqn_name           = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_down_time              = 720 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] shell_completion               = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] snapshot_name_template         = snapshot-%s {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] split_loggers                  = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] state_path                     = /opt/stack/data/cinder {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] storage_availability_zone      = nova {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] storage_protocol               = iSCSI {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] syslog_log_facility            = LOG_USER {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] target_helper                  = lioadm {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] target_ip_address              = 192.168.122.251 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] target_port                    = 3260 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] target_protocol                = iscsi {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] target_secondary_ip_addresses  = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] trace_flags                    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] transport_url                  = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] until_refresh                  = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] use_chap_auth                  = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] use_default_quota_class        = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] use_journal                    = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] use_json                       = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] use_multipath_for_image_xfer   = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] use_stderr                     = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] use_syslog                     = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] verify_glance_signatures       = enabled {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_api_class               = cinder.volume.api.API {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_backend_name            = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_clear                   = zero {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_clear_ionice            = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_clear_size              = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_copy_bps_limit          = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_dd_blocksize            = 1M {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_name_template           = volume-%s {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_service_inithost_offload = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volume_usage_audit_period      = month {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] zoning_mode                    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_concurrency.disable_process_locking = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.admin_password = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.admin_token = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.admin_user  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.auth_port   = 35357 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.auth_protocol = https {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.auth_section = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.auth_type   = password {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.auth_uri    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.auth_version = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.cache       = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.certfile    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.delay_auth_decision = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.http_connect_timeout = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.identity_uri = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.include_service_catalog = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.insecure    = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.interface   = public {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.keyfile     = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_password =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82517) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 13 18:41:02 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.quobyte [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 13 18:41:02 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.quobyte [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Running cmd (subprocess): mount.quobyte {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcache_username =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.region_name = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.service_token_roles_required = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.service_type = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.token_cache_time = 300 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.backend                  = dogpile.cache.null {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.backend_argument         = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.backend_expiration_time  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.config_prefix            = cache.oslo {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.debug_cache_backend      = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.enable_retry_client      = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.enable_socket_keepalive  = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.enabled                  = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.enforce_fips_mode        = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.expiration_time          = 600 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.hashclient_retry_attempts = 2 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.memcache_dead_retry      = 300 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.memcache_pool_maxsize    = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.memcache_sasl_enabled    = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.password                 = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.proxies                  = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.redis_db                 = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.redis_sentinel_service_name = mymaster {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.redis_server             = localhost:6379 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.retry_attempts           = 2 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.retry_delay              = 0.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.socket_keepalive_count   = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.socket_keepalive_idle    = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.socket_keepalive_interval = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.socket_timeout           = 1.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.tls_allowed_ciphers      = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.tls_cafile               = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.tls_certfile             = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.tls_enabled              = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.tls_keyfile              = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cache.username                 = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] coordination.backend_url       = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.asyncio_connection    = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.asyncio_slave_connection = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.backend               = sqlalchemy {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.connection            = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.connection_debug      = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.connection_parameters =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.connection_recycle_time = 3600 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.connection_trace      = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.db_inc_retry_interval = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.db_max_retries        = 20 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.db_max_retry_interval = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.db_retry_interval     = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.max_overflow          = 50 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.max_pool_size         = 5 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.max_retries           = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.mysql_wsrep_sync_wait = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.pool_timeout          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.retry_interval        = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.slave_connection      = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.sqlite_synchronous    = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.synchronous_reader    = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] database.use_db_reconnect      = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.connection_string     = messaging:// {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.enabled               = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.es_doc_type           = notification {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.es_scroll_size        = 10000 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.es_scroll_time        = 2m {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.filter_error_trace    = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.hmac_keys             = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.sentinel_service_name = mymaster {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.socket_timeout        = 0.1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.trace_requests        = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler.trace_sqlalchemy      = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler_jaeger.process_tags   = {} {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler_jaeger.service_name_prefix = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] profiler_otlp.service_name_prefix = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.enforce_new_defaults = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: WARNING oslo_config.cfg [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.enforce_scope      = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.policy_default_rule = default {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.policy_file        = policy.yaml {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] privsep_osbrick.group          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] privsep_osbrick.helper_command = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] privsep_osbrick.user           = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cinder_sys_admin.group         = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cinder_sys_admin.helper_command = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] cinder_sys_admin.user          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.auth_section      = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.auth_type         = password {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.cafile            = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.certfile          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.collect_timing    = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.insecure          = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.keyfile           = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.send_service_user_token = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.split_loggers     = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] service_user.timeout           = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.auth_section            = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.auth_type               = password {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.certfile                = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.collect_timing          = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.insecure                = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.keyfile                 = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.region_name             = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.split_loggers           = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] glance.timeout                 = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.backend_availability_zone = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.chap_password = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.chap_username =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.disk_geometry = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.driver_client_cert = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.driver_client_cert_key = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.driver_data_namespace = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.driver_use_ssl = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.enable_unsupported_driver = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.extra_capabilities = {} {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.filter_function = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.goodness_function = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack quobyte-client[82533]: Reading configuration file: /etc/quobyte/client.cfg
Apr 13 18:41:02 devstack quobyte-client[82533]: Invalid parameters found, error: missing mount point.
Apr 13 18:41:02 devstack quobyte-client[82533]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 13 18:41:02 devstack quobyte-client[82533]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.iscsi_target_flags =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.iscsi_write_cache = on {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.iser_helper   = tgtadm {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.iser_port     = 3260 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_host      =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_login     = admin {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_mount_options = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_password  = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_private_key =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_share_path =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.num_shell_tries = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.nvmet_port_id = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.quobyte_client_cfg = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.quobyte_volume_url = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.replication_device = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.report_discard_supported = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.reserved_percentage = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.scst_target_driver = iscsi {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.scst_target_iqn_name = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.storage_protocol = iSCSI {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.target_helper = tgtadm {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.target_port   = 3260 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.target_protocol = iscsi {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.trace_flags   = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.unique_fqdn_network = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.use_chap_auth = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.volume_backend_name = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.volume_clear  = zero {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.volume_clear_ionice = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.volume_clear_size = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_reports.file_event_handler = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_reports.log_dir           = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.backend_availability_zone = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.backend_host         = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.chap_password        = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.chap_username        = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.chiscsi_conf         = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.disk_geometry        = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.driver_client_cert   = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.driver_client_cert_key = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.driver_data_namespace = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.driver_use_ssl       = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.extra_capabilities   = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.filter_function      = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.goodness_function    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack sudo[82546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.iser_helper          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack sudo[82546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.iser_ip_address      = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.iser_port            = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.iser_target_prefix   = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_host             = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_login            = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_mount_options    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_password         = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_private_key      = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_share_path       = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_ssh_port         = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.num_shell_tries      = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.nvmet_port_id        = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.replication_device   = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.report_discard_supported = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.reserved_percentage  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.scst_target_driver   = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.storage_protocol     = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.target_helper        = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.target_ip_address    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.target_port          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.target_prefix        = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.target_protocol      = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.trace_flags          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.use_chap_auth        = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.volume_clear         = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.volume_clear_size    = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] QuobyteHD.volumes_dir          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.ssl      = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_notifications.driver = [] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_notifications.retry = -1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] oslo_messaging_notifications.transport_url = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] key_manager.fixed_key          = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.barbican_api_version  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.barbican_endpoint     = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.barbican_endpoint_type = public {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.barbican_region_name  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.cafile                = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.certfile              = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.collect_timing        = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.insecure              = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.keyfile               = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.number_of_retries     = 60 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.retry_delay           = 1 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.send_service_user_token = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.split_loggers         = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.timeout               = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.verify_ssl            = True {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican.verify_ssl_path       = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican_service_user.auth_section = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican_service_user.auth_type = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican_service_user.cafile   = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican_service_user.certfile = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican_service_user.collect_timing = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican_service_user.insecure = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican_service_user.keyfile  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican_service_user.split_loggers = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] barbican_service_user.timeout  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.approle_role_id          = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.approle_secret_id        = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.kv_mountpoint            = secret {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.kv_path                  = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.kv_version               = 2 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.namespace                = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.root_token_id            = **** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.ssl_ca_crt_file          = None {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.timeout                  = 60.0 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.use_ssl                  = False {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 18:41:02 devstack cinder-volume[82370]: DEBUG oslo_service.backend._eventlet.service [None req-d525ea75-d8a4-4c58-970d-95e9dcacd60d None None] ******************************************************************************** {{(pid=82370) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 18:41:02 devstack sudo[82546]: pam_unix(sudo:session): session closed for user root
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.516s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:41:02 devstack cinder-volume[82517]: INFO cinder.volume.driver [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG cinder.volume.driver [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7193908691406, 'free_capacity_gb': 1775.7193908691406, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82517) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_db.sqlalchemy.engines [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writer thread running {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG cinder.db.sqlalchemy.api [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Building query based on filter {{(pid=82517) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82517) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:41:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:41:02 devstack cinder-volume[82517]: INFO cinder.keymgr.migration [None req-22a3d77c-3297-44df-9d2e-a0bfd9833aa4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 18:41:02 devstack sudo[82596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:41:02 devstack sudo[82596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:41:03 devstack sudo[82596]: pam_unix(sudo:session): session closed for user root
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.404s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:41:03 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Driver initialization completed successfully.
Apr 13 18:41:03 devstack cinder-volume[82517]: INFO cinder.manager [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Initiating service 3 cleanup
Apr 13 18:41:03 devstack cinder-volume[82517]: INFO cinder.manager [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Service 3 cleanup completed.
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG cinder.service [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Creating RPC server for service cinder-volume {{(pid=82517) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG cinder.service [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82517) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 18:41:03 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:41:03 devstack sudo[82614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:41:03 devstack sudo[82614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:41:03 devstack sudo[82614]: pam_unix(sudo:session): session closed for user root
Apr 13 18:41:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.404s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:41:03 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bdb58028-7790-49c5-9fbd-abe92a094864 None None] Driver post RPC initialization completed successfully.
Apr 13 18:41:12 devstack cinder-volume[82370]: DEBUG dbcounter [-] [82370] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82370) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:41:13 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:41:13 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=2 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:42:01 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:42:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Flow 'volume_create_manager' (458002a0-ca39-44f6-8959-8d0687dd27b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ad3daa-5c75-4a73-be5c-7bb97b3e0d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ad3daa-5c75-4a73-be5c-7bb97b3e0d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-853179217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4a5cb7-3a70-4ab4-9784-cfcefee044a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b997fdd94b9d95d64d5569500e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:02Z,use_quota=True,user_id='a52b96d5b1184440b536f23edce13d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a9a741-00ea-4329-858b-f61d4d7e6084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a9a741-00ea-4329-858b-f61d4d7e6084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889a3c0a-06f8-493e-98bf-bf56c8f3b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889a3c0a-06f8-493e-98bf-bf56c8f3b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4a5cb7-3a70-4ab4-9784-cfcefee044a2', 'volume_name': 'volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d2ff6b-319e-4cdb-8fff-8ef638b5f88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d2ff6b-319e-4cdb-8fff-8ef638b5f88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9292ad9-87d7-48e3-bb60-5a1a4581f939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:02 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Volume 4a4a5cb7-3a70-4ab4-9784-cfcefee044a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2', 'volume_size': 1}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-853179217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4a5cb7-3a70-4ab4-9784-cfcefee044a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8457b997fdd94b9d95d64d5569500e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:02Z,use_quota=True,user_id='a52b96d5b1184440b536f23edce13d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Creating volume 4a4a5cb7-3a70-4ab4-9784-cfcefee044a2 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:42:02 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:42:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:02 devstack sudo[83096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2 1073741824
Apr 13 18:42:02 devstack sudo[83096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:02 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-98bd2a15-6aaa-4c33-83e3-322287b76b22 tempest-GroupSnapshotsV319Test-159551795 None] Group tempest-GroupSnapshotsV319Test-Group-1228645130: creating
Apr 13 18:42:02 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-98bd2a15-6aaa-4c33-83e3-322287b76b22 tempest-GroupSnapshotsV319Test-159551795 None] Group tempest-GroupSnapshotsV319Test-Group-1228645130: created successfully
Apr 13 18:42:02 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-98bd2a15-6aaa-4c33-83e3-322287b76b22 tempest-GroupSnapshotsV319Test-159551795 None] Create group completed successfully.
Apr 13 18:42:03 devstack sudo[83096]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2 1073741824" returned: 0 in 1.692s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:03 devstack sudo[83436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2
Apr 13 18:42:03 devstack sudo[83436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Flow 'volume_create_manager' (19c30c08-8eca-4f96-a58c-00efbf5a0d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d406c8a1-5043-4420-9d19-28f0e72e3ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d406c8a1-5043-4420-9d19-28f0e72e3ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-247823097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=515b20af-55ed-4644-ba7b-412f2e58e4dc,host='devstack@QuobyteHD#QuobyteHD',id=00c19533-a5d5-4ecc-a1c8-c6b31faeb273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d0e41aeac5422a99c1f38d41ea1f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:04Z,use_quota=True,user_id='6af8711d084849f8bbfc3f5953ffe20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e671c63c-5f68-49aa-848c-a3e0935e8dd8),volume_type_id=e671c63c-5f68-49aa-848c-a3e0935e8dd8)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101adae4-4d7a-4fc7-a149-231855efad34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101adae4-4d7a-4fc7-a149-231855efad34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe2c49f-b188-4119-8f8d-58ba78b080c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe2c49f-b188-4119-8f8d-58ba78b080c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c19533-a5d5-4ecc-a1c8-c6b31faeb273', 'volume_name': 'volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f155099-133d-49a8-8adc-71be5d1d0613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f155099-133d-49a8-8adc-71be5d1d0613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb732e47-adaa-40f1-b893-2eb608ab6a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:04 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Volume 00c19533-a5d5-4ecc-a1c8-c6b31faeb273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273', 'volume_size': 1}
Apr 13 18:42:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:05 devstack sudo[83436]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2" returned: 0 in 1.224s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] <== create_volume: return (2996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.999s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=515b20af-55ed-4644-ba7b-412f2e58e4dc,created_at=2026-04-13T16:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-247823097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=515b20af-55ed-4644-ba7b-412f2e58e4dc,host='devstack@QuobyteHD#QuobyteHD',id=00c19533-a5d5-4ecc-a1c8-c6b31faeb273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52d0e41aeac5422a99c1f38d41ea1f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:04Z,use_quota=True,user_id='6af8711d084849f8bbfc3f5953ffe20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e671c63c-5f68-49aa-848c-a3e0935e8dd8),volume_type_id=e671c63c-5f68-49aa-848c-a3e0935e8dd8)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Creating volume 00c19533-a5d5-4ecc-a1c8-c6b31faeb273 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:42:05 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:05 devstack sudo[83441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 1073741824
Apr 13 18:42:05 devstack sudo[83441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9292ad9-87d7-48e3-bb60-5a1a4581f939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7dd831-3559-4126-9858-10f9e51a84d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:05 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Volume volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2 (4a4a5cb7-3a70-4ab4-9784-cfcefee044a2): created successfully
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba7dd831-3559-4126-9858-10f9e51a84d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Flow 'volume_create_manager' (458002a0-ca39-44f6-8959-8d0687dd27b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-137e4dac-8a4b-40c8-ba35-5eb5720253af tempest-VolumesAdminNegativeTest-1002863036 None] Created volume successfully.
Apr 13 18:42:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Acquiring lock "cinder-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Lock "cinder-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Acquiring lock "cinder-quobyte-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Lock "cinder-quobyte-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2" acquired by "delete_volume" :: waited 0.029s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:06 devstack cinder-volume[82517]: INFO oslo.privsep.daemon [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpefnp9gyu/privsep.sock']
Apr 13 18:42:06 devstack sudo[83471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpefnp9gyu/privsep.sock
Apr 13 18:42:06 devstack sudo[83471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:07 devstack sudo[83441]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 1073741824" returned: 0 in 1.893s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:07 devstack sudo[83473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273
Apr 13 18:42:07 devstack sudo[83473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:07 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 13 18:42:07 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 18:42:07 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 13 18:42:07 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 18:42:07 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 13 18:42:07 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 13 18:42:07 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 18:42:07 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 18:42:07 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 13 18:42:08 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 13 18:42:08 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 18:42:08 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 13 18:42:08 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 18:42:08 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 13 18:42:08 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 13 18:42:08 devstack sudo[83473]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:08 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 18:42:08 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 18:42:08 devstack cinder-volume[82517]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 13 18:42:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" returned: 0 in 1.601s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] <== create_volume: return (3583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:42:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.585s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb732e47-adaa-40f1-b893-2eb608ab6a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d3a94e-eded-4ae0-9917-87634b3fb516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:08 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Volume volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 (00c19533-a5d5-4ecc-a1c8-c6b31faeb273): created successfully
Apr 13 18:42:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d3a94e-eded-4ae0-9917-87634b3fb516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Flow 'volume_create_manager' (19c30c08-8eca-4f96-a58c-00efbf5a0d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:08 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-92ecdd21-e21a-4f5d-ad07-1b9f6bb9cd54 tempest-GroupSnapshotsV319Test-159551795 None] Created volume successfully.
Apr 13 18:42:09 devstack sudo[83471]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:09 devstack cinder-volume[82517]: INFO oslo.privsep.daemon [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Spawned new privsep daemon via rootwrap
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Accepted privsep connection to /tmp/tmpefnp9gyu/privsep.sock {{(pid=82517) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 13 18:42:09 devstack cinder-volume[82517]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 18:42:09 devstack cinder-volume[82517]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 18:42:09 devstack cinder-volume[82517]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 18:42:09 devstack cinder-volume[82517]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83495
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[19444d99-3b59-47d6-835b-78f23c0debf1]: (2,) {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a10423d-e514-4e16-86a9-f58100e8d089]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:09 devstack sudo[83499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2
Apr 13 18:42:09 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:09 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] GroupSnapshot 9469f0b8-ae17-487e-9896-db39b3efc84a: creating.
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Group snapshot 9469f0b8-ae17-487e-9896-db39b3efc84a: creating. {{(pid=82517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Creating offline snapshot bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 of volume 00c19533-a5d5-4ecc-a1c8-c6b31faeb273 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fbb8b1-f8e0-4c8d-b876-25ea8064e102]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:09 devstack sudo[83509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273
Apr 13 18:42:09 devstack sudo[83509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:10 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2" returned: 0 in 1.131s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:10 devstack sudo[83516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2
Apr 13 18:42:10 devstack sudo[83516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:10 devstack sudo[83509]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" returned: 0 in 0.934s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:10 devstack sudo[83521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 1G
Apr 13 18:42:10 devstack sudo[83521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:11 devstack sudo[83516]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2" returned: 0 in 0.765s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Lock "cinder-quobyte-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2" released by "delete_volume" :: held 4.530s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:11 devstack cinder-volume[82517]: WARNING cinder.quota [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:42:11 devstack cinder-volume[82517]: WARNING cinder.quota [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Created reservations ['04a139d1-9b65-41fb-93d0-105ff379ea9e', 'e86c8c36-90a2-4a1e-9bef-a837aaec9518', '4c18618b-1737-4bab-aa22-2e4dcedbace6', 'acdee6d1-eb63-413e-8c2a-46bd97d09714'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:11 devstack sudo[83524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:42:11 devstack sudo[83524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:11 devstack sudo[83521]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 1G" returned: 0 in 1.166s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:11 devstack sudo[83553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93
Apr 13 18:42:11 devstack sudo[83553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:12 devstack sudo[83524]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.711s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:12 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:42:12 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Deleted volume successfully.
Apr 13 18:42:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-45c04e6f-4278-4011-90e6-4a16cb5f882e tempest-VolumesAdminNegativeTest-1002863036 None] Lock "cinder-4a4a5cb7-3a70-4ab4-9784-cfcefee044a2-delete_volume" released by "delete_volume" :: held 5.585s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:12 devstack sudo[83553]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93" returned: 0 in 0.603s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:12 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:42:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:12 devstack sudo[83562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93
Apr 13 18:42:12 devstack sudo[83562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:13 devstack sudo[83562]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93" returned: 0 in 1.088s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:13 devstack sudo[83577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.info
Apr 13 18:42:13 devstack sudo[83577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:14 devstack sudo[83577]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.info" returned: 0 in 0.827s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:14 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:42:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:14 devstack sudo[83609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.info
Apr 13 18:42:14 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:14 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.info" returned: 0 in 0.550s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.323s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:15 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5836c4d5-5f9c-4a30-88ce-78ee6326f59e tempest-GroupSnapshotsV319Test-159551795 None] group_snapshot 9469f0b8-ae17-487e-9896-db39b3efc84a: created successfully
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Flow 'volume_create_manager' (2647256a-da28-4933-a38c-1538fdbf407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880bc0db-e537-49b5-a96e-2d8bc3d431e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880bc0db-e537-49b5-a96e-2d8bc3d431e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-159236089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b37b88-e9ba-4a81-9fb5-f9df303aad6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daefb017502748c18d478e5ee8b637ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:15Z,use_quota=True,user_id='0c79307aba5d4b12bc5acb916af2828c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f205fed-86e2-419b-ae72-33006ba876e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f205fed-86e2-419b-ae72-33006ba876e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06b96fa-878c-4881-9035-b487cb6fda92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06b96fa-878c-4881-9035-b487cb6fda92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b37b88-e9ba-4a81-9fb5-f9df303aad6e', 'volume_name': 'volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1f31e0-31f5-4248-a255-d5fb4b5fde63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1f31e0-31f5-4248-a255-d5fb4b5fde63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31ebb56-b2a3-49ef-9366-4d05aece3878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:15 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Volume 06b37b88-e9ba-4a81-9fb5-f9df303aad6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e', 'volume_size': 1}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-159236089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b37b88-e9ba-4a81-9fb5-f9df303aad6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daefb017502748c18d478e5ee8b637ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:15Z,use_quota=True,user_id='0c79307aba5d4b12bc5acb916af2828c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Creating volume 06b37b88-e9ba-4a81-9fb5-f9df303aad6e {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:42:15 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:15 devstack sudo[83614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e 1073741824
Apr 13 18:42:15 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:15 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e 1073741824" returned: 0 in 0.642s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:16 devstack sudo[83621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e
Apr 13 18:42:16 devstack sudo[83621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:16 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] group_snapshot 9469f0b8-ae17-487e-9896-db39b3efc84a: deleting
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] group_snapshot 9469f0b8-ae17-487e-9896-db39b3efc84a: deleting {{(pid=82517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Acquiring lock "cinder-quobyte-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Lock "cinder-quobyte-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Acquiring lock "cinder-quobyte-bb93e3d1-df75-4536-9f9d-f9d44f6cdf93" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Lock "cinder-quobyte-bb93e3d1-df75-4536-9f9d-f9d44f6cdf93" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Deleting offline snapshot bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 of volume 00c19533-a5d5-4ecc-a1c8-c6b31faeb273 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] snapshot_file for this snap is: volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[23af1e22-e780-4705-9c01-6c3354a0885e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:16 devstack sudo[83621]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e" returned: 0 in 0.925s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31ebb56-b2a3-49ef-9366-4d05aece3878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094bb7d6-453b-4a4b-9262-4ab8f987c7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:16 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Volume volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e (06b37b88-e9ba-4a81-9fb5-f9df303aad6e): created successfully
Apr 13 18:42:16 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094bb7d6-453b-4a4b-9262-4ab8f987c7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Flow 'volume_create_manager' (2647256a-da28-4933-a38c-1538fdbf407f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:17 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9a965c47-5988-46a3-8957-819f18812993 tempest-ServerRescueNegativeTestJSON-320192387 None] Created volume successfully.
Apr 13 18:42:17 devstack sudo[83627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93
Apr 13 18:42:17 devstack sudo[83627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:17 devstack sudo[83627]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93" returned: 0 in 0.634s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:42:17 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b981f95-839c-4b13-a9ca-94ae2b272e92]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:17 devstack sudo[83632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273
Apr 13 18:42:17 devstack sudo[83632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:18 devstack sudo[83632]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" returned: 0 in 0.609s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:18 devstack sudo[83671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93
Apr 13 18:42:18 devstack sudo[83671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:18 devstack sudo[83671]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93" returned: 0 in 0.724s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:18 devstack sudo[83678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93
Apr 13 18:42:18 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:19 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273.bb93e3d1-df75-4536-9f9d-f9d44f6cdf93" returned: 0 in 1.003s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Lock "cinder-quobyte-bb93e3d1-df75-4536-9f9d-f9d44f6cdf93" released by "_delete_snapshot" :: held 3.048s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Lock "cinder-quobyte-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" released by "delete_snapshot" :: held 3.073s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:20 devstack cinder-volume[82517]: WARNING cinder.quota [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-539431558 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-539431558, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:42:20 devstack cinder-volume[82517]: WARNING cinder.quota [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-539431558 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-539431558, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:42:20 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] Created reservations ['1b801623-ecb1-4ed8-9a33-f3de73f5e83b', '721410fc-457b-486e-afc0-edd74134df55', '7df8361d-3e44-4dcc-8263-a472ac74de77', '6292ce3a-2a05-4a98-85ae-34d05f4065b7'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:42:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-dac1e7f0-7aa6-4fe5-819c-8e4b463b9923 tempest-GroupSnapshotsV319Test-159551795 None] group_snapshot 9469f0b8-ae17-487e-9896-db39b3efc84a: deleted successfully
Apr 13 18:42:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Acquiring lock "cinder-quobyte-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Lock "cinder-quobyte-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" acquired by "delete_volume" :: waited 0.025s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:20 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[80689109-22a8-4ed3-a564-ee60f31866bf]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:21 devstack sudo[83695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273
Apr 13 18:42:21 devstack sudo[83695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:21 devstack sudo[83695]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" returned: 0 in 0.821s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:21 devstack sudo[83705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273
Apr 13 18:42:21 devstack sudo[83705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:22 devstack sudo[83705]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" returned: 0 in 0.665s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Lock "cinder-quobyte-00c19533-a5d5-4ecc-a1c8-c6b31faeb273" released by "delete_volume" :: held 1.566s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Created reservations ['e1a0824f-deaf-41dc-ac40-5cfa9c6445f8'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:42:22 devstack cinder-volume[82517]: WARNING cinder.quota [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-539431558 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-539431558, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Created reservations ['6bab2096-ff75-4aeb-91d6-7931ca212451', '033f42f3-ab1e-4ad4-9846-76687415a0ad', '5e7d6a5d-5a88-404d-9c3d-30abbaaaaddd', 'f951b30a-22ac-4a60-81a9-399098483170'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:22 devstack sudo[83733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:42:22 devstack sudo[83733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:23 devstack sudo[83733]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.599s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:23 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:42:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a400a68b-7ba0-4101-9e59-bcae8bf8d9a3 tempest-GroupSnapshotsV319Test-159551795 None] Delete group completed successfully.
Apr 13 18:42:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bd550906-166d-4e02-b2ee-fb5c8080f990 tempest-GroupsV314Test-972375136 None] Group tempest-GroupsV314Test-Group-1409053110: creating
Apr 13 18:42:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bd550906-166d-4e02-b2ee-fb5c8080f990 tempest-GroupsV314Test-972375136 None] Group tempest-GroupsV314Test-Group-1409053110: created successfully
Apr 13 18:42:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bd550906-166d-4e02-b2ee-fb5c8080f990 tempest-GroupsV314Test-972375136 None] Create group completed successfully.
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Flow 'volume_create_manager' (b9ddea10-c6e6-4b4e-a064-d3918199e407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ae044a-cc66-42dc-9b20-ef2949d1bc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ae044a-cc66-42dc-9b20-ef2949d1bc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-332800032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868f7807-b091-480d-8d17-5136746ad9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc6dbc9e224769978dd774c998e2e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:29Z,use_quota=True,user_id='f97305dda0f14dac965e653222b66c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903654b9-74d0-4e0f-80f8-af408da517c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903654b9-74d0-4e0f-80f8-af408da517c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e225f4-6acc-4d10-a10e-5e2d7c5f00da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e225f4-6acc-4d10-a10e-5e2d7c5f00da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868f7807-b091-480d-8d17-5136746ad9e7', 'volume_name': 'volume-868f7807-b091-480d-8d17-5136746ad9e7', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104194eb-ea8d-4777-b904-f9a6065f5cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104194eb-ea8d-4777-b904-f9a6065f5cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35999d78-18f7-453a-9a2a-076f3a0ddbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:29 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Volume 868f7807-b091-480d-8d17-5136746ad9e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868f7807-b091-480d-8d17-5136746ad9e7', 'volume_size': 1}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-332800032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868f7807-b091-480d-8d17-5136746ad9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc6dbc9e224769978dd774c998e2e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:29Z,use_quota=True,user_id='f97305dda0f14dac965e653222b66c8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Creating volume 868f7807-b091-480d-8d17-5136746ad9e7 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:42:29 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:42:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:29 devstack sudo[83820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7 1073741824
Apr 13 18:42:29 devstack sudo[83820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Flow 'volume_create_manager' (e0e1b5cb-6bee-4c56-8003-a5410d7e6e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f4827b-2353-4854-bb22-4b7180166192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f4827b-2353-4854-bb22-4b7180166192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-620211035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df49c3d2-1502-4ef4-b34d-90a661592e7d,host='devstack@QuobyteHD#QuobyteHD',id=51eaab75-b680-477e-b78d-e0abed8fc3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e5da9329834b8ba5d74931876fea4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:30Z,use_quota=True,user_id='7f0a938d81f34e4b83ec65a36e9825ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a8d9855-cc7f-40de-8254-38cf33178c44),volume_type_id=5a8d9855-cc7f-40de-8254-38cf33178c44)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e66bd55-876a-421f-bf7f-0a6817fc5287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e66bd55-876a-421f-bf7f-0a6817fc5287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711a3151-1674-4819-ae29-506ae634fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711a3151-1674-4819-ae29-506ae634fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51eaab75-b680-477e-b78d-e0abed8fc3b8', 'volume_name': 'volume-51eaab75-b680-477e-b78d-e0abed8fc3b8', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6c9a21-ace4-45ec-8518-3c66983cf6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6c9a21-ace4-45ec-8518-3c66983cf6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bcec70-6d01-457d-9b0b-a29dc24845e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Volume 51eaab75-b680-477e-b78d-e0abed8fc3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51eaab75-b680-477e-b78d-e0abed8fc3b8', 'volume_size': 1}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:30 devstack sudo[83820]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7 1073741824" returned: 0 in 1.191s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:30 devstack sudo[83828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7
Apr 13 18:42:30 devstack sudo[83828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:31 devstack sudo[83828]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7" returned: 0 in 0.695s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df49c3d2-1502-4ef4-b34d-90a661592e7d,created_at=2026-04-13T16:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-620211035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df49c3d2-1502-4ef4-b34d-90a661592e7d,host='devstack@QuobyteHD#QuobyteHD',id=51eaab75-b680-477e-b78d-e0abed8fc3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09e5da9329834b8ba5d74931876fea4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:30Z,use_quota=True,user_id='7f0a938d81f34e4b83ec65a36e9825ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a8d9855-cc7f-40de-8254-38cf33178c44),volume_type_id=5a8d9855-cc7f-40de-8254-38cf33178c44)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Creating volume 51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:42:31 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35999d78-18f7-453a-9a2a-076f3a0ddbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868f7807-b091-480d-8d17-5136746ad9e7', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282a0fc4-92c3-4fd2-b2dc-0fea4a13e65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:31 devstack sudo[83832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 1073741824
Apr 13 18:42:31 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Volume volume-868f7807-b091-480d-8d17-5136746ad9e7 (868f7807-b091-480d-8d17-5136746ad9e7): created successfully
Apr 13 18:42:31 devstack sudo[83832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282a0fc4-92c3-4fd2-b2dc-0fea4a13e65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Flow 'volume_create_manager' (b9ddea10-c6e6-4b4e-a064-d3918199e407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:31 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-105fc547-2996-4f36-94f1-c6f2c2cc5299 tempest-DeleteServersTestJSON-2054612975 None] Created volume successfully.
Apr 13 18:42:33 devstack sudo[83832]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 1073741824" returned: 0 in 1.551s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:33 devstack sudo[83844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8
Apr 13 18:42:33 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:34 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8" returned: 0 in 1.062s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:42:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.684s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bcec70-6d01-457d-9b0b-a29dc24845e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51eaab75-b680-477e-b78d-e0abed8fc3b8', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77c88d2-52f1-4628-b6c8-5b0c55bc475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:34 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Volume volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 (51eaab75-b680-477e-b78d-e0abed8fc3b8): created successfully
Apr 13 18:42:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77c88d2-52f1-4628-b6c8-5b0c55bc475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Flow 'volume_create_manager' (e0e1b5cb-6bee-4c56-8003-a5410d7e6e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:34 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b90b43da-1feb-4ff8-abc2-c542b72fe71e tempest-GroupsV314Test-972375136 None] Created volume successfully.
Apr 13 18:42:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Acquiring lock "cinder-06b37b88-e9ba-4a81-9fb5-f9df303aad6e-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "cinder-06b37b88-e9ba-4a81-9fb5-f9df303aad6e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Acquiring lock "cinder-quobyte-06b37b88-e9ba-4a81-9fb5-f9df303aad6e" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "cinder-quobyte-06b37b88-e9ba-4a81-9fb5-f9df303aad6e" acquired by "delete_volume" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:35 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a4495c-38d4-425c-a8b0-d2b51accaf35]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:36 devstack sudo[83909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e
Apr 13 18:42:36 devstack sudo[83909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:36 devstack sudo[83909]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e" returned: 0 in 0.990s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:37 devstack sudo[83915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e
Apr 13 18:42:37 devstack sudo[83915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:37 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Cloning volume 51eaab75-b680-477e-b78d-e0abed8fc3b8 to volume 04b971f3-f39c-4e66-9280-8ef2a46b5f3a
Apr 13 18:42:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Creating offline snapshot 3e15050f-98bd-42cd-aed7-b7d011f3b162 of volume 51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:42:37 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f9b177-6611-41e5-b20d-026ab6d44a4b]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:37 devstack sudo[83917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8
Apr 13 18:42:37 devstack sudo[83917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:37 devstack sudo[83915]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-06b37b88-e9ba-4a81-9fb5-f9df303aad6e" returned: 0 in 1.055s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "cinder-quobyte-06b37b88-e9ba-4a81-9fb5-f9df303aad6e" released by "delete_volume" :: held 2.151s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Created reservations ['852dfed7-1e7b-4d0f-9204-c01be5566e9b', '45fc8692-cdc8-4ac2-bbba-d4f31ffa1076', '7301057c-6c55-4aed-8e75-b45666b2aaee', 'cdebf74c-b442-4131-87c3-aae5ffa6dcc0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:38 devstack sudo[83926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:42:38 devstack sudo[83926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:38 devstack sudo[83917]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8" returned: 0 in 1.453s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:38 devstack sudo[83936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 1G
Apr 13 18:42:38 devstack sudo[83936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:38 devstack cinder-volume[82517]: WARNING py.warnings [req-150d0f25-2218-45c5-96ba-2e035e660bc9 req-7c88171c-5ec3-4c20-8d69-86b76d279fa8 tempest-DeleteServersTestJSON-2054612975 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 13 18:42:38 devstack cinder-volume[82517]:   .first()
Apr 13 18:42:38 devstack cinder-volume[82517]: 
Apr 13 18:42:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-150d0f25-2218-45c5-96ba-2e035e660bc9 req-7c88171c-5ec3-4c20-8d69-86b76d279fa8 tempest-DeleteServersTestJSON-2054612975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:39 devstack sudo[83926]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.861s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:39 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:42:39 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Deleted volume successfully.
Apr 13 18:42:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe548314-6595-4914-b6c9-0572ec4dd0f6 tempest-ServerRescueNegativeTestJSON-320192387 None] Lock "cinder-06b37b88-e9ba-4a81-9fb5-f9df303aad6e-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:40 devstack sudo[83936]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 1G" returned: 0 in 1.416s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:40 devstack sudo[83944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162
Apr 13 18:42:40 devstack sudo[83944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:40 devstack sudo[83944]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162" returned: 0 in 0.754s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:40 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:42:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:40 devstack sudo[83973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162
Apr 13 18:42:40 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:41 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162" returned: 0 in 0.845s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:41 devstack sudo[83979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.info
Apr 13 18:42:41 devstack sudo[83979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:42 devstack sudo[83979]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.info" returned: 0 in 0.854s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:42 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:42:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:42 devstack sudo[83985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.info
Apr 13 18:42:42 devstack sudo[83985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:42 devstack sudo[83985]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.info" returned: 0 in 0.411s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Acquiring lock "cinder-quobyte-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Lock "cinder-quobyte-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] snapshot: 3e15050f-98bd-42cd-aed7-b7d011f3b162, volume: 04b971f3-f39c-4e66-9280-8ef2a46b5f3a,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cd7baa-1035-4305-ae6c-262ad27bae2d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:43 devstack sudo[83988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162
Apr 13 18:42:43 devstack sudo[83988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:43 devstack sudo[83988]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162" returned: 0 in 0.501s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51eaab75-b680-477e-b78d-e0abed8fc3b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1f2a35-73b6-4fb1-9672-4d8e826f9e4e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-efd34471-6393-4284-a760-0b7f20f15f8a tempest-BackendsCapabilitiesAdminTestsJSON-1987676899 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7193908691406, 'free_capacity_gb': 1775.7193908691406, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82517) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 13 18:42:43 devstack sudo[83995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8
Apr 13 18:42:43 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:44 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8" returned: 0 in 0.522s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:44 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:42:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:44 devstack sudo[84000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a
Apr 13 18:42:44 devstack sudo[84000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7002eae3-8975-418f-8bb1-271f17d204f6 tempest-BackendsCapabilitiesAdminTestsJSON-1987676899 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7193908691406, 'free_capacity_gb': 1775.7193908691406, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82517) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 13 18:42:47 devstack sudo[84000]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" returned: 0 in 3.172s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:47 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61aee28-7708-49ad-b672-ae9bb147efe1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:47 devstack sudo[84028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8
Apr 13 18:42:47 devstack sudo[84028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:47 devstack sudo[84028]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8" returned: 0 in 0.703s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:47 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8, size 1024.00 MB, duration 3.17 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:42:47 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Converted 1024.00 MB image at 322.66 MB/s
Apr 13 18:42:47 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:42:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:47 devstack sudo[84035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a
Apr 13 18:42:47 devstack sudo[84035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:48 devstack sudo[84035]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" returned: 0 in 0.604s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Lock "cinder-quobyte-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" released by "_copy_volume_from_snapshot" :: held 5.561s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Acquiring lock "cinder-quobyte-3e15050f-98bd-42cd-aed7-b7d011f3b162" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Lock "cinder-quobyte-3e15050f-98bd-42cd-aed7-b7d011f3b162" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Deleting offline snapshot 3e15050f-98bd-42cd-aed7-b7d011f3b162 of volume 51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:42:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] snapshot_file for this snap is: volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:42:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[98649c4a-f8fd-4d81-b5f5-930b091e9865]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:48 devstack sudo[84065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162
Apr 13 18:42:48 devstack sudo[84065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:49 devstack sudo[84065]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162" returned: 0 in 0.682s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51eaab75-b680-477e-b78d-e0abed8fc3b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:42:49 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b96447-7ddf-4785-87cb-30775ecfadf5]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:49 devstack sudo[84071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8
Apr 13 18:42:49 devstack sudo[84071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:49 devstack sudo[84071]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8" returned: 0 in 0.651s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:50 devstack sudo[84078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162
Apr 13 18:42:50 devstack sudo[84078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:50 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e65108d3-bea8-4188-b4dd-828564eaa36a tempest-GroupSnapshotsTest-1214879321 None] Group tempest-GroupSnapshotsTest-Group-387670190: creating
Apr 13 18:42:50 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e65108d3-bea8-4188-b4dd-828564eaa36a tempest-GroupSnapshotsTest-1214879321 None] Group tempest-GroupSnapshotsTest-Group-387670190: created successfully
Apr 13 18:42:50 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e65108d3-bea8-4188-b4dd-828564eaa36a tempest-GroupSnapshotsTest-1214879321 None] Create group completed successfully.
Apr 13 18:42:50 devstack sudo[84078]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162" returned: 0 in 0.530s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:50 devstack sudo[84085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162
Apr 13 18:42:50 devstack sudo[84085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:50 devstack sudo[84085]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8.3e15050f-98bd-42cd-aed7-b7d011f3b162" returned: 0 in 0.425s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Lock "cinder-quobyte-3e15050f-98bd-42cd-aed7-b7d011f3b162" released by "_delete_snapshot" :: held 2.352s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.895s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-150d0f25-2218-45c5-96ba-2e035e660bc9 req-7c88171c-5ec3-4c20-8d69-86b76d279fa8 tempest-DeleteServersTestJSON-2054612975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.969s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:50 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f11eec-bad7-4d95-816e-8bf8204931e8]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-150d0f25-2218-45c5-96ba-2e035e660bc9 req-7c88171c-5ec3-4c20-8d69-86b76d279fa8 tempest-DeleteServersTestJSON-2054612975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:51 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-fb9607ac-9461-41ff-a72a-ec96c66fec61 tempest-GroupsV314Test-972375136 None] Create group from source-group-df49c3d2-1502-4ef4-b34d-90a661592e7d completed successfully.
Apr 13 18:42:51 devstack sudo[84088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7
Apr 13 18:42:51 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:51 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-150d0f25-2218-45c5-96ba-2e035e660bc9 req-7c88171c-5ec3-4c20-8d69-86b76d279fa8 tempest-DeleteServersTestJSON-2054612975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7" returned: 0 in 0.494s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-150d0f25-2218-45c5-96ba-2e035e660bc9 req-7c88171c-5ec3-4c20-8d69-86b76d279fa8 tempest-DeleteServersTestJSON-2054612975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.505s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-150d0f25-2218-45c5-96ba-2e035e660bc9 req-7c88171c-5ec3-4c20-8d69-86b76d279fa8 tempest-DeleteServersTestJSON-2054612975 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f', 'name': 'volume-868f7807-b091-480d-8d17-5136746ad9e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a01bcea-6916-4843-9c86-c7e4d2b037db', 'enforce_multipath': True} {{(pid=82517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 18:42:51 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-150d0f25-2218-45c5-96ba-2e035e660bc9 req-7c88171c-5ec3-4c20-8d69-86b76d279fa8 tempest-DeleteServersTestJSON-2054612975 None] attachment_update completed successfully.
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Flow 'volume_create_manager' (2c71666e-4e53-4faf-8397-f2688e2af6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b251de2b-8243-4ad0-8b3d-e32e54f2f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b251de2b-8243-4ad0-8b3d-e32e54f2f33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-492795245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=67a475f2-7be6-4c90-af45-a814ea3e3b3c,host='devstack@QuobyteHD#QuobyteHD',id=852e627e-beb6-48c6-acd9-def2104a2ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90e23b81c984cf1b3baa6578f9c5ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:52Z,use_quota=True,user_id='e25a60ed29134e18bf839006b4e7f52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c142ff-3cf4-4694-9666-c072c29ad6c5),volume_type_id=c5c142ff-3cf4-4694-9666-c072c29ad6c5)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc6c4fa-2c94-4de9-abf7-19ab7de5d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc6c4fa-2c94-4de9-abf7-19ab7de5d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69212388-3025-4923-9981-aced517a5f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69212388-3025-4923-9981-aced517a5f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852e627e-beb6-48c6-acd9-def2104a2ceb', 'volume_name': 'volume-852e627e-beb6-48c6-acd9-def2104a2ceb', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458811be-511b-467c-aa8c-b44cf3551ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458811be-511b-467c-aa8c-b44cf3551ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c8e78e-a57c-40ec-907a-f32fab10ee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:51 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Volume 852e627e-beb6-48c6-acd9-def2104a2ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852e627e-beb6-48c6-acd9-def2104a2ceb', 'volume_size': 1}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=67a475f2-7be6-4c90-af45-a814ea3e3b3c,created_at=2026-04-13T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-492795245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=67a475f2-7be6-4c90-af45-a814ea3e3b3c,host='devstack@QuobyteHD#QuobyteHD',id=852e627e-beb6-48c6-acd9-def2104a2ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90e23b81c984cf1b3baa6578f9c5ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:42:52Z,use_quota=True,user_id='e25a60ed29134e18bf839006b4e7f52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5c142ff-3cf4-4694-9666-c072c29ad6c5),volume_type_id=c5c142ff-3cf4-4694-9666-c072c29ad6c5)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Creating volume 852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:42:51 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:42:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:51 devstack sudo[84096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb 1073741824
Apr 13 18:42:51 devstack sudo[84096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Acquiring lock "cinder-quobyte-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Lock "cinder-quobyte-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" acquired by "delete_volume" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[26666a74-0e36-46e6-9095-57269da4fc46]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:52 devstack sudo[84099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a
Apr 13 18:42:52 devstack sudo[84099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:52 devstack sudo[84096]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb 1073741824" returned: 0 in 0.638s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:52 devstack sudo[84197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb
Apr 13 18:42:52 devstack sudo[84197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:52 devstack sudo[84099]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" returned: 0 in 0.573s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:52 devstack sudo[84202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a
Apr 13 18:42:52 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:52 devstack sudo[84197]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb" returned: 0 in 0.407s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c8e78e-a57c-40ec-907a-f32fab10ee79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852e627e-beb6-48c6-acd9-def2104a2ceb', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a676891-81c4-462b-8fbf-6dfee1cd023a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:42:52 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Volume volume-852e627e-beb6-48c6-acd9-def2104a2ceb (852e627e-beb6-48c6-acd9-def2104a2ceb): created successfully
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a676891-81c4-462b-8fbf-6dfee1cd023a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:42:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Flow 'volume_create_manager' (2c71666e-4e53-4faf-8397-f2688e2af6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:42:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3ae9d3e6-9feb-479b-8a1b-8ee740ceb2e5 tempest-GroupSnapshotsTest-1214879321 None] Created volume successfully.
Apr 13 18:42:53 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" returned: 0 in 0.448s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Lock "cinder-quobyte-04b971f3-f39c-4e66-9280-8ef2a46b5f3a" released by "delete_volume" :: held 1.073s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Created reservations ['23208acc-9c51-468d-94c6-46e563c8de58'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:42:53 devstack cinder-volume[82517]: WARNING cinder.quota [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1176573886 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1176573886, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:42:53 devstack cinder-volume[82517]: WARNING cinder.quota [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1176573886 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1176573886, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Created reservations ['06a17a81-42e7-4dad-96f6-15dbc94909aa', '19c69f32-0106-4e1d-848e-de51cbe2ed9b', '6e6b1354-5e24-4bca-a503-aaf1b68bf0c5', '499f8adb-2ab5-4de2-8112-afb31e7cc1c2'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:53 devstack sudo[84522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:42:53 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:53 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.445s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:53 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:42:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-43c1dad8-ffe7-4a39-b3da-ca61cb696765 tempest-GroupsV314Test-972375136 None] Delete group completed successfully.
Apr 13 18:42:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] GroupSnapshot 22df0582-a6e6-456c-bf3a-1b771bfa818f: creating.
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:UPDATE=60,cinder:SELECT=72,cinder:DELETE=7,cinder:INSERT=13 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=70,cinder:UPDATE=84,cinder:INSERT=18,cinder:DELETE=1 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Group snapshot 22df0582-a6e6-456c-bf3a-1b771bfa818f: creating. {{(pid=82517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Creating offline snapshot 2f128b32-270f-4ab7-b43c-16055a6126f9 of volume 852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0e872b-e912-48a9-ab6b-0322cd70374b]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:54 devstack sudo[84526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb
Apr 13 18:42:54 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Acquiring lock "cinder-quobyte-51eaab75-b680-477e-b78d-e0abed8fc3b8" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Lock "cinder-quobyte-51eaab75-b680-477e-b78d-e0abed8fc3b8" acquired by "delete_volume" :: waited 0.051s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faa1a11-521d-4249-99f6-7bd2c01438fe]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:54 devstack sudo[84529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8
Apr 13 18:42:54 devstack sudo[84529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:54 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb" returned: 0 in 0.619s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:54 devstack sudo[84534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 1G
Apr 13 18:42:54 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:55 devstack sudo[84529]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8" returned: 0 in 0.570s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:55 devstack sudo[84542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8
Apr 13 18:42:55 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:55 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 1G" returned: 0 in 0.570s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852e627e-beb6-48c6-acd9-def2104a2ceb -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:55 devstack sudo[84544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852e627e-beb6-48c6-acd9-def2104a2ceb -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9
Apr 13 18:42:55 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:55 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51eaab75-b680-477e-b78d-e0abed8fc3b8" returned: 0 in 0.690s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Lock "cinder-quobyte-51eaab75-b680-477e-b78d-e0abed8fc3b8" released by "delete_volume" :: held 1.321s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:42:55 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-852e627e-beb6-48c6-acd9-def2104a2ceb -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9" returned: 0 in 0.583s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:55 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:55 devstack sudo[84551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9
Apr 13 18:42:55 devstack sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Created reservations ['2a48ec0d-8e78-493f-b5d5-972f01e1faab'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Created reservations ['9822a645-a353-4820-a1d1-77aaad25016f', '49cfbfea-aaad-4ba1-8954-5411ff19c4eb', '986d4649-d527-4baa-b20b-f7af05bc1339', 'b5733d48-ca6b-484f-bf73-b3d3969949de'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:55 devstack sudo[84554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:42:55 devstack sudo[84554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:56 devstack sudo[84551]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9" returned: 0 in 0.534s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:56 devstack sudo[84557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.info
Apr 13 18:42:56 devstack sudo[84557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:56 devstack sudo[84554]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.758s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:56 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:42:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5eefff7a-42b0-4aa1-aba7-4081df874c0c tempest-GroupsV314Test-972375136 None] Delete group completed successfully.
Apr 13 18:42:57 devstack sudo[84557]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.info" returned: 0 in 0.645s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:57 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:42:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:57 devstack sudo[84562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.info
Apr 13 18:42:57 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:57 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.info" returned: 0 in 0.513s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.573s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:57 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ee60fe3b-e88a-47fb-a248-3b72e5603a33 tempest-GroupSnapshotsTest-1214879321 None] group_snapshot 22df0582-a6e6-456c-bf3a-1b771bfa818f: created successfully
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-2f128b32-270f-4ab7-b43c-16055a6126f9-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" by "_create_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-2f128b32-270f-4ab7-b43c-16055a6126f9-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Creating volume 5b120a3a-24b8-4b7c-abc9-1b2a89486ddf from snapshot 2f128b32-270f-4ab7-b43c-16055a6126f9 {{(pid=82517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] snapshot: 2f128b32-270f-4ab7-b43c-16055a6126f9, volume: 5b120a3a-24b8-4b7c-abc9-1b2a89486ddf,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46e0b57-bf46-463f-aa23-5543858b43ed]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:42:59 devstack sudo[84619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9
Apr 13 18:42:59 devstack sudo[84619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:42:59 devstack sudo[84619]: pam_unix(sudo:session): session closed for user root
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9" returned: 0 in 0.672s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852e627e-beb6-48c6-acd9-def2104a2ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[81771adf-952f-4761-8f12-6d0d314c7061]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:42:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:00 devstack sudo[84627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb
Apr 13 18:43:00 devstack sudo[84627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:00 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-fc3a8fbf-b898-4464-a6a1-9646662da3cc req-711b84f4-8375-4ac9-949c-4ad9845dda07 tempest-DeleteServersTestJSON-2054612975 None] Terminate volume connection completed successfully.
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-fc3a8fbf-b898-4464-a6a1-9646662da3cc req-711b84f4-8375-4ac9-949c-4ad9845dda07 tempest-DeleteServersTestJSON-2054612975 None] Deleting attachment 3a01bcea-6916-4843-9c86-c7e4d2b037db. {{(pid=82517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 18:43:00 devstack sudo[84627]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb" returned: 0 in 0.614s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:00 devstack sudo[84632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf
Apr 13 18:43:00 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG oslo_service.periodic_task [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:00 devstack sudo[84634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:43:00 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:02 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 1.546s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:02 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:43:03 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" returned: 0 in 2.469s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:03 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e801f2a-e342-479c-b5c1-c7c34dcc373f]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:03 devstack sudo[84648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb
Apr 13 18:43:03 devstack sudo[84648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:03 devstack sudo[84648]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb" returned: 0 in 0.857s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:03 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:43:03 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Converted 1024.00 MB image at 414.60 MB/s
Apr 13 18:43:03 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:43:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:03 devstack sudo[84655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf
Apr 13 18:43:03 devstack sudo[84655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Acquiring lock "cinder-868f7807-b091-480d-8d17-5136746ad9e7-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Lock "cinder-868f7807-b091-480d-8d17-5136746ad9e7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Acquiring lock "cinder-quobyte-868f7807-b091-480d-8d17-5136746ad9e7" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Lock "cinder-quobyte-868f7807-b091-480d-8d17-5136746ad9e7" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3da71d-059d-4944-99df-d8642817a81b]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:04 devstack sudo[84657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7
Apr 13 18:43:04 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:04 devstack sudo[84655]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" returned: 0 in 0.666s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" released by "_copy_volume_from_snapshot" :: held 5.358s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-2f128b32-270f-4ab7-b43c-16055a6126f9-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" released by "_create_volume_from_snapshot" :: held 5.377s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.389s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:04 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a90f8aef-cc20-44ab-9bee-6f8cdc0c2a33 tempest-GroupSnapshotsTest-1214879321 None] Create group from source-snapshot-22df0582-a6e6-456c-bf3a-1b771bfa818f completed successfully.
Apr 13 18:43:04 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7" returned: 0 in 0.544s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:05 devstack sudo[84663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7
Apr 13 18:43:05 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" acquired by "delete_volume" :: waited 0.018s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a40da19-45ea-4dec-8822-da64385bac6c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:05 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-868f7807-b091-480d-8d17-5136746ad9e7" returned: 0 in 0.605s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Lock "cinder-quobyte-868f7807-b091-480d-8d17-5136746ad9e7" released by "delete_volume" :: held 1.206s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:05 devstack sudo[84666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf
Apr 13 18:43:05 devstack sudo[84666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Created reservations ['ed9884e1-80ed-4dbf-a878-831edef312fe', '81246df9-53eb-4d8d-9e7c-4f0e9450e7c9', 'e22df3a8-a14f-4728-8b0a-ecd6ef5ccb7d', '566c32a7-265e-4700-85e9-31bb3b88cfbc'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:05 devstack sudo[84668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:43:05 devstack sudo[84668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:06 devstack sudo[84666]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" returned: 0 in 0.804s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:06 devstack sudo[84674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf
Apr 13 18:43:06 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:06 devstack sudo[84668]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.721s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:06 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:43:06 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Deleted volume successfully.
Apr 13 18:43:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9e4db250-8c27-49dc-b61a-148d23eee10c tempest-DeleteServersTestJSON-2054612975 None] Lock "cinder-868f7807-b091-480d-8d17-5136746ad9e7-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:06 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" returned: 0 in 0.639s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-5b120a3a-24b8-4b7c-abc9-1b2a89486ddf" released by "delete_volume" :: held 1.482s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:06 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['71529fb0-4f77-4df7-bf46-8682054b1594'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:07 devstack cinder-volume[82517]: WARNING cinder.quota [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-914596440 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-914596440, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:43:07 devstack cinder-volume[82517]: WARNING cinder.quota [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-914596440 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-914596440, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['5206a679-6e81-46f3-9f03-113a332ec6d8', 'bae5a95b-5cae-445d-a4ac-6f6dc070046a', 'd0050a8f-3021-4d0e-859a-f57fe5312bdd', '3a6684fd-d9d1-47d8-b287-3812311fc678'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:07 devstack sudo[84678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:43:07 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:07 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.526s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:43:07 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-8682c033-88f6-4272-9296-140c656c3bc9 tempest-GroupSnapshotsTest-1214879321 None] Delete group completed successfully.
Apr 13 18:43:07 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] group_snapshot 22df0582-a6e6-456c-bf3a-1b771bfa818f: deleting
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] group_snapshot 22df0582-a6e6-456c-bf3a-1b771bfa818f: deleting {{(pid=82517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-852e627e-beb6-48c6-acd9-def2104a2ceb" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-852e627e-beb6-48c6-acd9-def2104a2ceb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-2f128b32-270f-4ab7-b43c-16055a6126f9" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-2f128b32-270f-4ab7-b43c-16055a6126f9" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Deleting offline snapshot 2f128b32-270f-4ab7-b43c-16055a6126f9 of volume 852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] snapshot_file for this snap is: volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[93251229-39c0-4317-9210-304c8933559e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:08 devstack sudo[84681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9
Apr 13 18:43:08 devstack sudo[84681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:08 devstack sudo[84681]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9" returned: 0 in 0.672s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-852e627e-beb6-48c6-acd9-def2104a2ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:43:08 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08e1035-06df-4405-a423-d7fe056e4166]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:08 devstack sudo[84691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb
Apr 13 18:43:08 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:09 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb" returned: 0 in 0.577s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:09 devstack sudo[84699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9
Apr 13 18:43:09 devstack sudo[84699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:09 devstack sudo[84699]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9" returned: 0 in 0.579s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:09 devstack sudo[84704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9
Apr 13 18:43:09 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:10 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb.2f128b32-270f-4ab7-b43c-16055a6126f9" returned: 0 in 0.535s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-2f128b32-270f-4ab7-b43c-16055a6126f9" released by "_delete_snapshot" :: held 2.423s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-852e627e-beb6-48c6-acd9-def2104a2ceb" released by "delete_snapshot" :: held 2.438s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:10 devstack cinder-volume[82517]: WARNING cinder.quota [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-914596440 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-914596440, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:43:10 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['661f9585-8d62-4972-b8bb-752e5433658e', '9b348941-d393-4ba9-a0e0-60d1462fe1fa', 'a1d2e580-0ea9-48d1-82a4-f1cb36c57ea3', '993cba4d-f696-48dd-9a67-cc9a113cdf8d'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:10 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-65979654-a637-4e78-af0d-6e82c45f981c tempest-GroupSnapshotsTest-1214879321 None] group_snapshot 22df0582-a6e6-456c-bf3a-1b771bfa818f: deleted successfully
Apr 13 18:43:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-852e627e-beb6-48c6-acd9-def2104a2ceb" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-852e627e-beb6-48c6-acd9-def2104a2ceb" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:11 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f553b4a-0260-4dbc-929e-a846d3bbf530]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:11 devstack sudo[84709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb
Apr 13 18:43:11 devstack sudo[84709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:11 devstack sudo[84709]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb" returned: 0 in 0.501s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:11 devstack sudo[84714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb
Apr 13 18:43:11 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:12 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-852e627e-beb6-48c6-acd9-def2104a2ceb" returned: 0 in 0.463s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-852e627e-beb6-48c6-acd9-def2104a2ceb" released by "delete_volume" :: held 1.006s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['216873b7-9100-402e-8cac-f42a19e008dc'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:12 devstack cinder-volume[82517]: WARNING cinder.db.sqlalchemy.api [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-914596440']
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['c517b030-0555-400c-a1ae-74f327c9cf7f', '31c09367-1753-42c7-9592-85f2f3c88431', '8f68b796-d972-4639-9a57-253f04565c11', '9958eec2-c055-4c87-9b51-c693b91cd340'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:12 devstack sudo[84718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:43:12 devstack sudo[84718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:12 devstack sudo[84718]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.483s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:12 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:43:12 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-aedc02fe-2135-4d42-a841-e5909f841462 tempest-GroupSnapshotsTest-1214879321 None] Delete group completed successfully.
Apr 13 18:43:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-26eed78d-07c9-4eb1-9bb2-717122e46b2d tempest-GroupSnapshotsTest-1214879321 None] Group tempest-GroupSnapshotsTest-Group-1998199186: creating
Apr 13 18:43:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-26eed78d-07c9-4eb1-9bb2-717122e46b2d tempest-GroupSnapshotsTest-1214879321 None] Group tempest-GroupSnapshotsTest-Group-1998199186: created successfully
Apr 13 18:43:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-26eed78d-07c9-4eb1-9bb2-717122e46b2d tempest-GroupSnapshotsTest-1214879321 None] Create group completed successfully.
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Flow 'volume_create_manager' (33b89b15-b58e-40e4-b5b2-08767d19e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a104dd-6379-4fa5-a18f-086fb4993e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a104dd-6379-4fa5-a18f-086fb4993e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-992460293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21d0f793-99ac-42cc-8965-f5add4424f6d,host='devstack@QuobyteHD#QuobyteHD',id=6a42bf82-df1e-4e28-b115-2ad112b7c0bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90e23b81c984cf1b3baa6578f9c5ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:15Z,use_quota=True,user_id='e25a60ed29134e18bf839006b4e7f52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd9f6066-c054-4736-8c0a-9a664d14225d),volume_type_id=dd9f6066-c054-4736-8c0a-9a664d14225d)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a014f4-5930-42fb-8fbd-bdb5dd1b674a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a014f4-5930-42fb-8fbd-bdb5dd1b674a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8f1c61-7bee-4363-8b5b-4b2afb481210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8f1c61-7bee-4363-8b5b-4b2afb481210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a42bf82-df1e-4e28-b115-2ad112b7c0bc', 'volume_name': 'volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2777b01a-61cb-4ee8-a7e1-465c06c317f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2777b01a-61cb-4ee8-a7e1-465c06c317f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee61ff9-808f-4140-b909-ab71c482c935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:15 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Volume 6a42bf82-df1e-4e28-b115-2ad112b7c0bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc', 'volume_size': 1}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=21d0f793-99ac-42cc-8965-f5add4424f6d,created_at=2026-04-13T16:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-992460293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21d0f793-99ac-42cc-8965-f5add4424f6d,host='devstack@QuobyteHD#QuobyteHD',id=6a42bf82-df1e-4e28-b115-2ad112b7c0bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90e23b81c984cf1b3baa6578f9c5ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:15Z,use_quota=True,user_id='e25a60ed29134e18bf839006b4e7f52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd9f6066-c054-4736-8c0a-9a664d14225d),volume_type_id=dd9f6066-c054-4736-8c0a-9a664d14225d)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Creating volume 6a42bf82-df1e-4e28-b115-2ad112b7c0bc {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:43:15 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:15 devstack sudo[84746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc 1073741824
Apr 13 18:43:15 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:15 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc 1073741824" returned: 0 in 0.580s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:15 devstack sudo[84751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc
Apr 13 18:43:15 devstack sudo[84751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:16 devstack sudo[84751]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" returned: 0 in 0.516s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:16 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:43:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:16 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee61ff9-808f-4140-b909-ab71c482c935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:16 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2de0603-2204-4fb7-8082-e5b167524364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:16 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Volume volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc (6a42bf82-df1e-4e28-b115-2ad112b7c0bc): created successfully
Apr 13 18:43:16 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2de0603-2204-4fb7-8082-e5b167524364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:16 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Flow 'volume_create_manager' (33b89b15-b58e-40e4-b5b2-08767d19e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:16 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5db39560-d74c-4127-8171-61343ac49f62 tempest-GroupSnapshotsTest-1214879321 None] Created volume successfully.
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Flow 'volume_create_manager' (6a3e0de3-7d9f-46af-bede-ad9bf007b647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1cb25f-288a-4cde-9f99-c38eecca02df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1cb25f-288a-4cde-9f99-c38eecca02df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-115872874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21d0f793-99ac-42cc-8965-f5add4424f6d,host='devstack@QuobyteHD#QuobyteHD',id=9c0219f5-2d4b-4b6c-9e84-769e17d85f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90e23b81c984cf1b3baa6578f9c5ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:18Z,use_quota=True,user_id='e25a60ed29134e18bf839006b4e7f52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd9f6066-c054-4736-8c0a-9a664d14225d),volume_type_id=dd9f6066-c054-4736-8c0a-9a664d14225d)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3632ae95-13a6-4cc5-94a6-302961ea09a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3632ae95-13a6-4cc5-94a6-302961ea09a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c30b09b-5856-4584-b24d-632ca79a296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c30b09b-5856-4584-b24d-632ca79a296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0219f5-2d4b-4b6c-9e84-769e17d85f50', 'volume_name': 'volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd14992-6173-4316-baa7-fe4ca46e3250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd14992-6173-4316-baa7-fe4ca46e3250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9a987e-a4e2-44f0-9508-b544222dd13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:17 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Volume 9c0219f5-2d4b-4b6c-9e84-769e17d85f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50', 'volume_size': 1}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=21d0f793-99ac-42cc-8965-f5add4424f6d,created_at=2026-04-13T16:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-115872874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21d0f793-99ac-42cc-8965-f5add4424f6d,host='devstack@QuobyteHD#QuobyteHD',id=9c0219f5-2d4b-4b6c-9e84-769e17d85f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90e23b81c984cf1b3baa6578f9c5ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:18Z,use_quota=True,user_id='e25a60ed29134e18bf839006b4e7f52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd9f6066-c054-4736-8c0a-9a664d14225d),volume_type_id=dd9f6066-c054-4736-8c0a-9a664d14225d)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Creating volume 9c0219f5-2d4b-4b6c-9e84-769e17d85f50 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:43:17 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:43:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:17 devstack sudo[84754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 1073741824
Apr 13 18:43:17 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:18 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 1073741824" returned: 0 in 0.641s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:18 devstack sudo[84771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50
Apr 13 18:43:18 devstack sudo[84771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:19 devstack sudo[84771]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" returned: 0 in 0.687s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:43:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9a987e-a4e2-44f0-9508-b544222dd13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68259718-e4e8-4888-85eb-cea38b7173cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Volume volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 (9c0219f5-2d4b-4b6c-9e84-769e17d85f50): created successfully
Apr 13 18:43:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68259718-e4e8-4888-85eb-cea38b7173cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Flow 'volume_create_manager' (6a3e0de3-7d9f-46af-bede-ad9bf007b647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:19 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ec8669ab-d845-46a9-a509-dcc1d5305e3d tempest-GroupSnapshotsTest-1214879321 None] Created volume successfully.
Apr 13 18:43:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-46ae3b46-b965-4149-9ce2-4fca2d1d240b tempest-GroupSnapshotsTest-1214879321 None] Update group completed successfully.
Apr 13 18:43:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b6da5f3e-b49a-40b9-9d22-57beaccc3cf9 tempest-GroupSnapshotsTest-1214879321 None] Update group completed successfully.
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Flow 'volume_create_manager' (9c54d0e3-817a-4a5d-8526-3c55ff943c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0728b99b-1ca9-4722-a638-8941de528a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0728b99b-1ca9-4722-a638-8941de528a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-774343568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e65226c-1d8f-48a7-9f21-ed28cf856e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b710247b574a749290df26c583a66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:22Z,use_quota=True,user_id='8717274aabc54f8b9710d41d89d55448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(407883af-89a9-40ab-b8f5-0bfafa326b8a),volume_type_id=407883af-89a9-40ab-b8f5-0bfafa326b8a)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090a5b82-c17f-4a09-98ba-0e4d5e1203e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090a5b82-c17f-4a09-98ba-0e4d5e1203e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e68a734-9787-47e8-8d78-1bac50ea8ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e68a734-9787-47e8-8d78-1bac50ea8ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e65226c-1d8f-48a7-9f21-ed28cf856e3d', 'volume_name': 'volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352c2cc2-b992-4111-a207-cd7eeeaecc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352c2cc2-b992-4111-a207-cd7eeeaecc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a731d2-a478-44a2-b082-325caba1b280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:22 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Volume 4e65226c-1d8f-48a7-9f21-ed28cf856e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d', 'volume_size': 1}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-774343568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e65226c-1d8f-48a7-9f21-ed28cf856e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b710247b574a749290df26c583a66f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:22Z,use_quota=True,user_id='8717274aabc54f8b9710d41d89d55448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(407883af-89a9-40ab-b8f5-0bfafa326b8a),volume_type_id=407883af-89a9-40ab-b8f5-0bfafa326b8a)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Creating volume 4e65226c-1d8f-48a7-9f21-ed28cf856e3d {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:43:22 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:22 devstack sudo[84829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d 1073741824
Apr 13 18:43:22 devstack sudo[84829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9eb6156c-866d-42b1-acf7-90d7e83b58ec tempest-GroupSnapshotsTest-1214879321 None] Update group completed successfully.
Apr 13 18:43:22 devstack sudo[84829]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d 1073741824" returned: 0 in 0.505s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:22 devstack sudo[84834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d
Apr 13 18:43:22 devstack sudo[84834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:23 devstack sudo[84834]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d" returned: 0 in 0.513s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:43:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a731d2-a478-44a2-b082-325caba1b280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72baff3c-64a4-4fac-b9ad-3ed7581dbbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:23 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Volume volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d (4e65226c-1d8f-48a7-9f21-ed28cf856e3d): created successfully
Apr 13 18:43:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72baff3c-64a4-4fac-b9ad-3ed7581dbbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Flow 'volume_create_manager' (9c54d0e3-817a-4a5d-8526-3c55ff943c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-28c3d089-3744-458d-987a-98b7b4c1c579 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Created volume successfully.
Apr 13 18:43:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c96d6739-c4e0-4c7d-b3de-440e5338ee03 tempest-GroupSnapshotsTest-1214879321 None] Update group completed successfully.
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-25828c4c-caf6-462c-9f81-16711ba5e9de tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-25828c4c-caf6-462c-9f81-16711ba5e9de tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-25828c4c-caf6-462c-9f81-16711ba5e9de tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-25828c4c-caf6-462c-9f81-16711ba5e9de tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-25828c4c-caf6-462c-9f81-16711ba5e9de tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-25828c4c-caf6-462c-9f81-16711ba5e9de tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:24 devstack sudo[84840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:43:24 devstack sudo[84840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:24 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] GroupSnapshot e8c50768-f5cd-4044-b59a-f07851b635f1: creating.
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Group snapshot e8c50768-f5cd-4044-b59a-f07851b635f1: creating. {{(pid=82517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Creating offline snapshot 25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 of volume 9c0219f5-2d4b-4b6c-9e84-769e17d85f50 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1279111-b26b-4676-aadc-4c0d3ec63ff4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:24 devstack sudo[84843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50
Apr 13 18:43:24 devstack sudo[84843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:25 devstack sudo[84840]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-25828c4c-caf6-462c-9f81-16711ba5e9de tempest-VolumeRetypeWithoutMigrationTest-887904612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.547s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:25 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-25828c4c-caf6-462c-9f81-16711ba5e9de tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:43:25 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-25828c4c-caf6-462c-9f81-16711ba5e9de tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Retype volume completed successfully.
Apr 13 18:43:25 devstack sudo[84843]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" returned: 0 in 0.555s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:25 devstack sudo[84866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 1G
Apr 13 18:43:25 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:26 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 1G" returned: 0 in 0.553s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:26 devstack sudo[84871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5
Apr 13 18:43:26 devstack sudo[84871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Acquiring lock "cinder-4e65226c-1d8f-48a7-9f21-ed28cf856e3d-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "cinder-4e65226c-1d8f-48a7-9f21-ed28cf856e3d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Acquiring lock "cinder-quobyte-4e65226c-1d8f-48a7-9f21-ed28cf856e3d" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "cinder-quobyte-4e65226c-1d8f-48a7-9f21-ed28cf856e3d" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeebfe8-ffd3-4e4e-9301-dccc3d749f46]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:26 devstack sudo[84873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d
Apr 13 18:43:26 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:26 devstack sudo[84871]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5" returned: 0 in 0.519s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:26 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:26 devstack sudo[84883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5
Apr 13 18:43:26 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:26 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d" returned: 0 in 0.513s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:26 devstack sudo[84885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d
Apr 13 18:43:26 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:27 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5" returned: 0 in 0.535s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:27 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.info
Apr 13 18:43:27 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:27 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4e65226c-1d8f-48a7-9f21-ed28cf856e3d" returned: 0 in 0.706s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "cinder-quobyte-4e65226c-1d8f-48a7-9f21-ed28cf856e3d" released by "delete_volume" :: held 1.241s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:27 devstack cinder-volume[82517]: WARNING cinder.quota [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:43:27 devstack cinder-volume[82517]: WARNING cinder.quota [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Created reservations ['86e312ed-eee4-4714-bb47-9e6cfafefae3', 'bc9e1e1c-ecd2-453b-8e3c-8b22c59e3689', '007942c0-cf3c-487f-bbe9-b6a89137118f', 'e0007c98-d0bc-4467-b1ce-678d89f24414'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:27 devstack sudo[84891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:43:27 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:27 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.info" returned: 0 in 0.516s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:27 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:27 devstack sudo[84897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.info
Apr 13 18:43:27 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:27 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.475s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:43:27 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Deleted volume successfully.
Apr 13 18:43:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c1f1e21b-f7a1-4443-930a-cae2c1f576d8 tempest-VolumeRetypeWithoutMigrationTest-887904612 None] Lock "cinder-4e65226c-1d8f-48a7-9f21-ed28cf856e3d-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:28 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.info" returned: 0 in 0.444s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Creating offline snapshot 79591919-1613-4811-86b5-b3ec566780ec of volume 6a42bf82-df1e-4e28-b115-2ad112b7c0bc {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:43:28 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5489a0-e988-4a8c-97b0-6b559c0ed485]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:28 devstack sudo[84901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc
Apr 13 18:43:28 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:28 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" returned: 0 in 0.555s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:28 devstack sudo[84906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec 1G
Apr 13 18:43:28 devstack sudo[84906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:29 devstack sudo[84906]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec 1G" returned: 0 in 1.177s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:29 devstack sudo[84942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec
Apr 13 18:43:29 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:30 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec" returned: 0 in 0.765s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:30 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:43:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:30 devstack sudo[84951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec
Apr 13 18:43:30 devstack sudo[84951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:31 devstack sudo[84951]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec" returned: 0 in 0.651s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:31 devstack sudo[84954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.info
Apr 13 18:43:31 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:31 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.info" returned: 0 in 0.672s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:31 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:43:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:31 devstack sudo[84958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.info
Apr 13 18:43:31 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:32 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.info" returned: 0 in 0.589s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.493s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:32 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bb2db44a-a5fa-479a-9917-66d894c30b17 tempest-GroupSnapshotsTest-1214879321 None] group_snapshot e8c50768-f5cd-4044-b59a-f07851b635f1: created successfully
Apr 13 18:43:33 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] group_snapshot e8c50768-f5cd-4044-b59a-f07851b635f1: deleting
Apr 13 18:43:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] group_snapshot e8c50768-f5cd-4044-b59a-f07851b635f1: deleting {{(pid=82517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 18:43:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-25bc07d9-1af6-4ac9-b4ac-835c3991a2a5" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-25bc07d9-1af6-4ac9-b4ac-835c3991a2a5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Deleting offline snapshot 25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 of volume 9c0219f5-2d4b-4b6c-9e84-769e17d85f50 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:43:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] snapshot_file for this snap is: volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:43:33 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2efd17a-1fa1-4ab1-b022-bc7c39b20309]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:33 devstack sudo[84963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5
Apr 13 18:43:33 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:35 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5" returned: 0 in 1.362s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:43:35 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[122eda01-e98c-4ca3-81b9-dc4ccd9e6e90]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:35 devstack sudo[84970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50
Apr 13 18:43:35 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:36 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" returned: 0 in 1.016s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:36 devstack sudo[84976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5
Apr 13 18:43:36 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:37 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5" returned: 0 in 1.177s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:37 devstack sudo[85007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5
Apr 13 18:43:37 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:37 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50.25bc07d9-1af6-4ac9-b4ac-835c3991a2a5" returned: 0 in 0.667s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-25bc07d9-1af6-4ac9-b4ac-835c3991a2a5" released by "_delete_snapshot" :: held 4.336s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" released by "delete_snapshot" :: held 4.358s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-79591919-1613-4811-86b5-b3ec566780ec" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-79591919-1613-4811-86b5-b3ec566780ec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Deleting offline snapshot 79591919-1613-4811-86b5-b3ec566780ec of volume 6a42bf82-df1e-4e28-b115-2ad112b7c0bc {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:43:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] snapshot_file for this snap is: volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:43:38 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7fd008-85e7-471d-82f4-76b07665d866]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:38 devstack sudo[85024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec
Apr 13 18:43:38 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:39 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec" returned: 0 in 0.972s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:43:39 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0514e0c-fbad-4462-a6af-0ddc4fe74f08]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:39 devstack sudo[85029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc
Apr 13 18:43:39 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:39 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" returned: 0 in 0.861s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:39 devstack sudo[85034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec
Apr 13 18:43:39 devstack sudo[85034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:40 devstack sudo[85034]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec" returned: 0 in 0.777s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:40 devstack sudo[85039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec
Apr 13 18:43:40 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:41 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc.79591919-1613-4811-86b5-b3ec566780ec" returned: 0 in 1.036s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-79591919-1613-4811-86b5-b3ec566780ec" released by "_delete_snapshot" :: held 3.800s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" released by "delete_snapshot" :: held 3.820s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:41 devstack cinder-volume[82517]: WARNING cinder.quota [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2044573000 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2044573000, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:43:41 devstack cinder-volume[82517]: WARNING cinder.quota [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2044573000 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2044573000, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:43:41 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['28710780-c1ea-4946-b2e0-87fea42dcbe5', '6dbd6781-ad63-4416-a58f-5d41b0028a93', '41cd55bd-e8b9-4f5e-9b9e-3c4eb7870b33', '8a9bdc7b-1fd8-471f-97bd-9e0c5c63935c'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:41 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['e4007bed-43a3-4510-b619-f01f7ea0ee5e', '0ed57f70-29b7-48cd-a523-b3cd5ef983b3', 'f329e7b5-030e-42fa-bee0-43b809b42bd1', 'dcd677e0-8ce0-43c1-9592-de92bb69b363'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:42 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-18624441-e95b-46f0-80a5-be44fa98d027 tempest-GroupSnapshotsTest-1214879321 None] group_snapshot e8c50768-f5cd-4044-b59a-f07851b635f1: deleted successfully
Apr 13 18:43:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" acquired by "delete_volume" :: waited 0.035s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:43 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05692fb-ab43-458c-8700-9c43ef9a16d2]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:43 devstack sudo[85073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc
Apr 13 18:43:43 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:44 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" returned: 0 in 1.335s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:44 devstack sudo[85085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc
Apr 13 18:43:44 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:45 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" returned: 0 in 1.246s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-6a42bf82-df1e-4e28-b115-2ad112b7c0bc" released by "delete_volume" :: held 2.789s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:43:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" acquired by "delete_volume" :: waited 0.025s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:43:46 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e263c8-88b3-48d2-b94e-2027098fd3d8]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:46 devstack sudo[85091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50
Apr 13 18:43:46 devstack sudo[85091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:47 devstack sudo[85091]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" returned: 0 in 1.210s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:47 devstack sudo[85097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50
Apr 13 18:43:47 devstack sudo[85097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:47 devstack sudo[85097]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" returned: 0 in 0.617s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-9c0219f5-2d4b-4b6c-9e84-769e17d85f50" released by "delete_volume" :: held 2.065s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:43:48 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['6c5ceb87-fea5-457d-98bf-c3fdf53caea7'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:48 devstack cinder-volume[82517]: WARNING cinder.quota [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2044573000 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2044573000, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:43:48 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['593bcef4-805d-4d54-b576-8fa509e4a67f', '4a47aa92-c648-4b56-94bf-3d17aa4d6e54', 'c1087640-3fce-4e35-97a6-f93af22d6fd7', '600fb1aa-0869-4c7c-af32-6f6385879217'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:48 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['90aabbd2-05b5-40fa-8398-33d3d07235e3', 'f17543ab-1576-453a-a0ba-8e4d818ebfe0', '25888e39-f6a1-475e-9176-9a075a764cba', 'df627cfa-5688-429f-9c76-a98f537c48f0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:43:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:48 devstack sudo[85128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:43:48 devstack sudo[85128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:49 devstack sudo[85128]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.840s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:49 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:43:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a35396e8-bad0-4e0d-bd1d-8f36850a8062 tempest-GroupSnapshotsTest-1214879321 None] Delete group completed successfully.
Apr 13 18:43:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3630605b-d99d-4118-97ac-9cfb506af518 tempest-GroupSnapshotsTest-1214879321 None] Group tempest-GroupSnapshotsTest-Group-544335214: creating
Apr 13 18:43:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3630605b-d99d-4118-97ac-9cfb506af518 tempest-GroupSnapshotsTest-1214879321 None] Group tempest-GroupSnapshotsTest-Group-544335214: created successfully
Apr 13 18:43:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3630605b-d99d-4118-97ac-9cfb506af518 tempest-GroupSnapshotsTest-1214879321 None] Create group completed successfully.
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Flow 'volume_create_manager' (7a10b531-f02a-428d-89e7-de6ccd1c030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6490e03e-3620-4dec-8d7b-e4630dbbf471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6490e03e-3620-4dec-8d7b-e4630dbbf471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:43:50Z,deleted=False,deleted_at=None,display_description='',display_name='70a8eeda-6e28-4797-90c7-564f1e95e2c3-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5721f913-3de2-449a-bf6e-ad64129aef08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fae38ae5a54b5da46dc562a5ca7e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:51Z,use_quota=True,user_id='f659ae901d8c40d390c0044ad5c0c982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76816be8-77ec-47b5-8430-b38da86eb7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76816be8-77ec-47b5-8430-b38da86eb7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8ae135-137a-4c74-a963-e5a3fc2d7e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f8ae135-137a-4c74-a963-e5a3fc2d7e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5721f913-3de2-449a-bf6e-ad64129aef08', 'volume_name': 'volume-5721f913-3de2-449a-bf6e-ad64129aef08', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7135fe-5ff7-4ce3-8cb3-0a9b121d4ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7135fe-5ff7-4ce3-8cb3-0a9b121d4ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5861d3-8395-455f-99b5-8fd6d3600ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:50 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Volume 5721f913-3de2-449a-bf6e-ad64129aef08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5721f913-3de2-449a-bf6e-ad64129aef08', 'volume_size': 1}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:43:50Z,deleted=False,deleted_at=None,display_description='',display_name='70a8eeda-6e28-4797-90c7-564f1e95e2c3-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5721f913-3de2-449a-bf6e-ad64129aef08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fae38ae5a54b5da46dc562a5ca7e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:51Z,use_quota=True,user_id='f659ae901d8c40d390c0044ad5c0c982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Creating volume 5721f913-3de2-449a-bf6e-ad64129aef08 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:43:50 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:43:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:50 devstack sudo[85139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08 1073741824
Apr 13 18:43:50 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Flow 'volume_create_manager' (04b86713-4e2d-4053-8f77-8611f663c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92877a8-1567-4e81-96c7-61d1bf0f70aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92877a8-1567-4e81-96c7-61d1bf0f70aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1367788796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fad47d27-9dfb-4c79-8959-7c089a0c5c3a,host='devstack@QuobyteHD#QuobyteHD',id=8ba74d0a-d243-4c94-95de-627a8de8c61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90e23b81c984cf1b3baa6578f9c5ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:52Z,use_quota=True,user_id='e25a60ed29134e18bf839006b4e7f52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ce32899-29d8-45f7-b1e1-dc720e9b8492),volume_type_id=3ce32899-29d8-45f7-b1e1-dc720e9b8492)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530a2b8c-3a2a-4ea0-9e15-e19d83bb6694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530a2b8c-3a2a-4ea0-9e15-e19d83bb6694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca8e7f5-6757-433c-9d33-9b82ebdf7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca8e7f5-6757-433c-9d33-9b82ebdf7407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba74d0a-d243-4c94-95de-627a8de8c61b', 'volume_name': 'volume-8ba74d0a-d243-4c94-95de-627a8de8c61b', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67a8689-62d1-4f4f-b1ab-1efad0fd4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67a8689-62d1-4f4f-b1ab-1efad0fd4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef74b06-64d0-4e85-b9ce-2e8d7e79eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:51 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Volume 8ba74d0a-d243-4c94-95de-627a8de8c61b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba74d0a-d243-4c94-95de-627a8de8c61b', 'volume_size': 1}
Apr 13 18:43:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:52 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08 1073741824" returned: 0 in 1.483s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:52 devstack sudo[85156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08
Apr 13 18:43:52 devstack sudo[85156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:53 devstack sudo[85156]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08" returned: 0 in 0.664s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fad47d27-9dfb-4c79-8959-7c089a0c5c3a,created_at=2026-04-13T16:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1367788796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fad47d27-9dfb-4c79-8959-7c089a0c5c3a,host='devstack@QuobyteHD#QuobyteHD',id=8ba74d0a-d243-4c94-95de-627a8de8c61b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90e23b81c984cf1b3baa6578f9c5ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:52Z,use_quota=True,user_id='e25a60ed29134e18bf839006b4e7f52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ce32899-29d8-45f7-b1e1-dc720e9b8492),volume_type_id=3ce32899-29d8-45f7-b1e1-dc720e9b8492)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Creating volume 8ba74d0a-d243-4c94-95de-627a8de8c61b {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:43:53 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:53 devstack sudo[85161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b 1073741824
Apr 13 18:43:53 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5861d3-8395-455f-99b5-8fd6d3600ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5721f913-3de2-449a-bf6e-ad64129aef08', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1b67e3-1c8d-490d-b834-bcc50bf0f9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:53 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Volume volume-5721f913-3de2-449a-bf6e-ad64129aef08 (5721f913-3de2-449a-bf6e-ad64129aef08): created successfully
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1b67e3-1c8d-490d-b834-bcc50bf0f9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Flow 'volume_create_manager' (7a10b531-f02a-428d-89e7-de6ccd1c030c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-71cbcd6e-b260-4faa-acc4-a1a3057f20b5 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Created volume successfully.
Apr 13 18:43:54 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b 1073741824" returned: 0 in 1.079s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=131,cinder:UPDATE=109,cinder:INSERT=26,cinder:DELETE=2 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=104,cinder:UPDATE=122,cinder:INSERT=25,cinder:DELETE=4 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:54 devstack sudo[85175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b
Apr 13 18:43:54 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-bd6e5dd6-7785-4f52-9b16-3d954ffe5446 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:54 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b" returned: 0 in 0.535s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-bd6e5dd6-7785-4f52-9b16-3d954ffe5446 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.393s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef74b06-64d0-4e85-b9ce-2e8d7e79eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba74d0a-d243-4c94-95de-627a8de8c61b', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e94cff1-6874-49e6-a8b3-2d44ace3b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6a2fae-9b4d-4464-a811-5f76186791e7]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-bd6e5dd6-7785-4f52-9b16-3d954ffe5446 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:54 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Volume volume-8ba74d0a-d243-4c94-95de-627a8de8c61b (8ba74d0a-d243-4c94-95de-627a8de8c61b): created successfully
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e94cff1-6874-49e6-a8b3-2d44ace3b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Flow 'volume_create_manager' (04b86713-4e2d-4053-8f77-8611f663c323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:54 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-94205ad8-fcba-4911-be26-07ca41c699d9 tempest-GroupSnapshotsTest-1214879321 None] Created volume successfully.
Apr 13 18:43:55 devstack sudo[85180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08
Apr 13 18:43:55 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:55 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-bd6e5dd6-7785-4f52-9b16-3d954ffe5446 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08" returned: 0 in 1.012s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-bd6e5dd6-7785-4f52-9b16-3d954ffe5446 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.059s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:43:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-bd6e5dd6-7785-4f52-9b16-3d954ffe5446 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f', 'name': 'volume-5721f913-3de2-449a-bf6e-ad64129aef08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db3a73fc-c583-4973-9214-8e06973aa827', 'enforce_multipath': True} {{(pid=82517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 18:43:55 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-7aacbf6b-a4fa-430e-8171-207b028adafe req-bd6e5dd6-7785-4f52-9b16-3d954ffe5446 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] attachment_update completed successfully.
Apr 13 18:43:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] GroupSnapshot 11f361da-ef39-4e45-9978-c69ff4feced9: creating.
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Group snapshot 11f361da-ef39-4e45-9978-c69ff4feced9: creating. {{(pid=82517) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Creating offline snapshot c767ab5c-02ab-4989-8487-cf3fc5a3ac91 of volume 8ba74d0a-d243-4c94-95de-627a8de8c61b {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecccce2c-50bd-4fde-ac00-24222f2ddac1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:56 devstack sudo[85185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b
Apr 13 18:43:56 devstack sudo[85185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Flow 'volume_create_manager' (64ba5bb9-79eb-4400-9b30-1773300a2ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96201cf2-0712-4efe-bd6c-87ec03a65d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96201cf2-0712-4efe-bd6c-87ec03a65d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1804404396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b8ebb1-235a-4215-a12c-17e815c4e6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecd321f8f1fc484fa889f22e0a270b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:57Z,use_quota=True,user_id='445c8033d8eb44a4a877109c80a3222a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7693228e-011d-4119-8978-c139547b0a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7693228e-011d-4119-8978-c139547b0a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9a1af8-0a00-4962-a231-47d2437389b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9a1af8-0a00-4962-a231-47d2437389b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b8ebb1-235a-4215-a12c-17e815c4e6c8', 'volume_name': 'volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbbdacc-0cce-44a3-a74d-f9648875af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbbdacc-0cce-44a3-a74d-f9648875af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c3180e-24a7-4ae0-91f0-c1109fafdaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:43:57 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Volume c0b8ebb1-235a-4215-a12c-17e815c4e6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8', 'volume_size': 1}
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:43:57 devstack sudo[85185]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b" returned: 0 in 1.137s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:57 devstack sudo[85190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 1G
Apr 13 18:43:57 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:58 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 1G" returned: 0 in 1.204s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ba74d0a-d243-4c94-95de-627a8de8c61b -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:58 devstack sudo[85264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ba74d0a-d243-4c94-95de-627a8de8c61b -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91
Apr 13 18:43:58 devstack sudo[85264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:43:59 devstack sudo[85264]: pam_unix(sudo:session): session closed for user root
Apr 13 18:43:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ba74d0a-d243-4c94-95de-627a8de8c61b -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91" returned: 0 in 0.616s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:43:59 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:43:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:43:59 devstack sudo[85272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91
Apr 13 18:43:59 devstack sudo[85272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:00 devstack sudo[85272]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91" returned: 0 in 0.683s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:00 devstack sudo[85278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.info
Apr 13 18:44:00 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:00 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.info" returned: 0 in 0.521s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:00 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:00 devstack sudo[85294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.info
Apr 13 18:44:00 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG oslo_service.periodic_task [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:00 devstack sudo[85296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:00 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:01 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.info" returned: 0 in 1.025s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.300s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.567s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1804404396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b8ebb1-235a-4215-a12c-17e815c4e6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecd321f8f1fc484fa889f22e0a270b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:43:57Z,use_quota=True,user_id='445c8033d8eb44a4a877109c80a3222a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Creating volume c0b8ebb1-235a-4215-a12c-17e815c4e6c8 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:01 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:01 devstack sudo[85634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8 1073741824
Apr 13 18:44:01 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:01 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e7c8b228-69b0-4b8d-a98c-12f2aecfd067 tempest-GroupSnapshotsTest-1214879321 None] group_snapshot 11f361da-ef39-4e45-9978-c69ff4feced9: created successfully
Apr 13 18:44:02 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 1.345s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:02 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8 1073741824" returned: 0 in 1.105s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:02 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] group_snapshot 11f361da-ef39-4e45-9978-c69ff4feced9: deleting
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] group_snapshot 11f361da-ef39-4e45-9978-c69ff4feced9: deleting {{(pid=82517) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-8ba74d0a-d243-4c94-95de-627a8de8c61b" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-8ba74d0a-d243-4c94-95de-627a8de8c61b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-c767ab5c-02ab-4989-8487-cf3fc5a3ac91" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-c767ab5c-02ab-4989-8487-cf3fc5a3ac91" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Deleting offline snapshot c767ab5c-02ab-4989-8487-cf3fc5a3ac91 of volume 8ba74d0a-d243-4c94-95de-627a8de8c61b {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:44:02 devstack sudo[85641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8
Apr 13 18:44:02 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] snapshot_file for this snap is: volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[60462255-0f37-4deb-a3f0-f9626f81bb4f]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:02 devstack sudo[85643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91
Apr 13 18:44:02 devstack sudo[85643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:03 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8" returned: 0 in 0.502s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c3180e-24a7-4ae0-91f0-c1109fafdaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f6c7d7-35e8-4d86-91a8-30c97aaa3091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:03 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Volume volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8 (c0b8ebb1-235a-4215-a12c-17e815c4e6c8): created successfully
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f6c7d7-35e8-4d86-91a8-30c97aaa3091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Flow 'volume_create_manager' (64ba5bb9-79eb-4400-9b30-1773300a2ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:03 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-54013fdb-6385-49f8-8f3f-757813ce0360 tempest-ServersNegativeTestJSON-882661375 None] Created volume successfully.
Apr 13 18:44:03 devstack sudo[85643]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91" returned: 0 in 0.681s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ba74d0a-d243-4c94-95de-627a8de8c61b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b946ff6-5805-4017-b7fc-4de7e8e7f9c1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:03 devstack sudo[85650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b
Apr 13 18:44:03 devstack sudo[85650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:04 devstack sudo[85650]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b" returned: 0 in 0.771s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:04 devstack sudo[85655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91
Apr 13 18:44:04 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Flow 'volume_create_manager' (eed13f37-6233-463f-9922-9c95b67de73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c592d577-8128-4087-be6a-836c932252d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c592d577-8128-4087-be6a-836c932252d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1191135271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5250ebd7-3099-4c5d-9e24-54efa4e17c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecd321f8f1fc484fa889f22e0a270b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:05Z,use_quota=True,user_id='445c8033d8eb44a4a877109c80a3222a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fac6be-ac83-4d5f-8971-fe3e3f07423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fac6be-ac83-4d5f-8971-fe3e3f07423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c665d48-a67e-4f6a-99c8-c78552391d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c665d48-a67e-4f6a-99c8-c78552391d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5250ebd7-3099-4c5d-9e24-54efa4e17c41', 'volume_name': 'volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f9f9f9-e580-4cca-8433-d5ffed73a2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f9f9f9-e580-4cca-8433-d5ffed73a2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a97ba5f-72e3-44b4-b479-21e4de17c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:04 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Volume 5250ebd7-3099-4c5d-9e24-54efa4e17c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41', 'volume_size': 1}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1191135271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5250ebd7-3099-4c5d-9e24-54efa4e17c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecd321f8f1fc484fa889f22e0a270b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:05Z,use_quota=True,user_id='445c8033d8eb44a4a877109c80a3222a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Creating volume 5250ebd7-3099-4c5d-9e24-54efa4e17c41 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:04 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:04 devstack sudo[85657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41 1073741824
Apr 13 18:44:04 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:05 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91" returned: 0 in 0.739s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:05 devstack sudo[85665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91
Apr 13 18:44:05 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:05 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41 1073741824" returned: 0 in 0.712s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:05 devstack sudo[85671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41
Apr 13 18:44:05 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:05 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b.c767ab5c-02ab-4989-8487-cf3fc5a3ac91" returned: 0 in 0.460s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-c767ab5c-02ab-4989-8487-cf3fc5a3ac91" released by "_delete_snapshot" :: held 2.737s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-8ba74d0a-d243-4c94-95de-627a8de8c61b" released by "delete_snapshot" :: held 2.763s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:05 devstack cinder-volume[82517]: WARNING cinder.quota [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1122619778 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1122619778, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:44:05 devstack cinder-volume[82517]: WARNING cinder.quota [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1122619778 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1122619778, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['ed68714b-32d2-4181-8b65-de77ad68db69', '1423c412-67f4-4c52-827f-a1710414c4ac', '90a8d30e-ddb9-4229-b8b1-670c950ac9e0', 'd230aed4-4c25-444c-9435-e4c758bb0ab0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9618cbce-40cb-4204-ae8c-9ce99cd72da6 tempest-GroupSnapshotsTest-1214879321 None] group_snapshot 11f361da-ef39-4e45-9978-c69ff4feced9: deleted successfully
Apr 13 18:44:05 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41" returned: 0 in 0.457s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a97ba5f-72e3-44b4-b479-21e4de17c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7673c7d-fcbe-4985-9573-644daab8b122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:05 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Volume volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41 (5250ebd7-3099-4c5d-9e24-54efa4e17c41): created successfully
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7673c7d-fcbe-4985-9573-644daab8b122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Flow 'volume_create_manager' (eed13f37-6233-463f-9922-9c95b67de73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d48ed6a3-2e6c-4bfe-acb4-0daa83570778 tempest-ServersNegativeTestJSON-882661375 None] Created volume successfully.
Apr 13 18:44:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "cinder-quobyte-8ba74d0a-d243-4c94-95de-627a8de8c61b" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-8ba74d0a-d243-4c94-95de-627a8de8c61b" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:06 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810f882-f95c-4f2a-aab4-97c2bc369c73]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:06 devstack sudo[85677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b
Apr 13 18:44:06 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:06 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:06 devstack sudo[85682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b
Apr 13 18:44:06 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "cinder-5250ebd7-3099-4c5d-9e24-54efa4e17c41-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Lock "cinder-5250ebd7-3099-4c5d-9e24-54efa4e17c41-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "cinder-quobyte-5250ebd7-3099-4c5d-9e24-54efa4e17c41" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Lock "cinder-quobyte-5250ebd7-3099-4c5d-9e24-54efa4e17c41" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74955ec-ccb5-48a7-9a20-a43a9703572e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:07 devstack sudo[85684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41
Apr 13 18:44:07 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:07 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8ba74d0a-d243-4c94-95de-627a8de8c61b" returned: 0 in 0.462s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Lock "cinder-quobyte-8ba74d0a-d243-4c94-95de-627a8de8c61b" released by "delete_volume" :: held 1.041s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['d61d4f11-b3ae-44fd-9050-657c03de8426'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:07 devstack cinder-volume[82517]: WARNING cinder.quota [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1122619778 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1122619778, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Created reservations ['696a04e2-70ec-40ec-a1c5-68d99a70240a', 'd7a91e9c-e81d-46c5-8f58-a7088be976c8', '3902d2e6-48c7-4689-b889-28f47c2063cf', '1a4bc30f-71bd-4d31-84c3-b6d69b5073a3'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:07 devstack sudo[85687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:07 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:07 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41" returned: 0 in 0.574s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:07 devstack sudo[85692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41
Apr 13 18:44:07 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:07 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.477s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:07 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:07 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2edd967f-ba15-4eaa-8073-cd289d99c43f tempest-GroupSnapshotsTest-1214879321 None] Delete group completed successfully.
Apr 13 18:44:08 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5250ebd7-3099-4c5d-9e24-54efa4e17c41" returned: 0 in 0.423s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Lock "cinder-quobyte-5250ebd7-3099-4c5d-9e24-54efa4e17c41" released by "delete_volume" :: held 1.026s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Created reservations ['93cf96bd-21da-41bb-94a0-1cc7af9dbc3c', 'a2cf2fae-7c84-4f4c-bbbb-edf9eedf2ae8', 'ee1c2466-79e4-4054-bd1a-cfb13a6cac40', '6b9c9556-b460-422f-9ee7-993ea802f0da'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:08 devstack sudo[85696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:08 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:08 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.447s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:08 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Deleted volume successfully.
Apr 13 18:44:08 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b438fc75-b907-4d07-a0bd-9fb2ff32254b tempest-ServersNegativeTestJSON-882661375 None] Lock "cinder-5250ebd7-3099-4c5d-9e24-54efa4e17c41-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "cinder-c0b8ebb1-235a-4215-a12c-17e815c4e6c8-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Lock "cinder-c0b8ebb1-235a-4215-a12c-17e815c4e6c8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "cinder-quobyte-c0b8ebb1-235a-4215-a12c-17e815c4e6c8" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Lock "cinder-quobyte-c0b8ebb1-235a-4215-a12c-17e815c4e6c8" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:09 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a0c95-3c8a-4daa-a163-f5d272eeaa43]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:09 devstack sudo[85703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8
Apr 13 18:44:09 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:10 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8" returned: 0 in 1.419s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:10 devstack sudo[85709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8
Apr 13 18:44:10 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:11 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c0b8ebb1-235a-4215-a12c-17e815c4e6c8" returned: 0 in 0.529s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Lock "cinder-quobyte-c0b8ebb1-235a-4215-a12c-17e815c4e6c8" released by "delete_volume" :: held 2.035s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:11 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Created reservations ['c9f1f79a-5a39-4e8f-a4fb-c6b236e42bee', '9b1f6c68-2c09-4e97-b24f-7c9fffcb226a', '4c90adc4-8f41-465e-96fb-01825ab3369b', '2b05f55d-be2b-45ca-b33d-855c19468948'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:11 devstack sudo[85726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:11 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:12 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.727s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:12 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:12 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Deleted volume successfully.
Apr 13 18:44:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2c4b8ddd-896f-4923-80a9-f7934fa02d2b tempest-ServersNegativeTestJSON-882661375 None] Lock "cinder-c0b8ebb1-235a-4215-a12c-17e815c4e6c8-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:16 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d2350f27-207d-40dd-8d14-20e5f7418e8a tempest-GroupsTest-1541747043 None] Group tempest-Group1-655397367: creating
Apr 13 18:44:16 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d2350f27-207d-40dd-8d14-20e5f7418e8a tempest-GroupsTest-1541747043 None] Group tempest-Group1-655397367: created successfully
Apr 13 18:44:16 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d2350f27-207d-40dd-8d14-20e5f7418e8a tempest-GroupsTest-1541747043 None] Create group completed successfully.
Apr 13 18:44:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2710cc9c-649a-41d8-adc1-784d2408fffc tempest-GroupsTest-1541747043 None] Group tempest-Group2-479218971: creating
Apr 13 18:44:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2710cc9c-649a-41d8-adc1-784d2408fffc tempest-GroupsTest-1541747043 None] Group tempest-Group2-479218971: created successfully
Apr 13 18:44:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2710cc9c-649a-41d8-adc1-784d2408fffc tempest-GroupsTest-1541747043 None] Create group completed successfully.
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (aed99d7d-9e2e-4596-b405-9577e4901441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea73ca4-0aec-4acb-b8fa-ee155288b338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea73ca4-0aec-4acb-b8fa-ee155288b338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1772864293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e2f41b-f360-4eba-8d11-300ba23f52b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:19Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c4af89-ba03-4464-b9d3-057c3e23763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c4af89-ba03-4464-b9d3-057c3e23763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44ded39-3299-40c5-b063-23b14d572522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44ded39-3299-40c5-b063-23b14d572522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e2f41b-f360-4eba-8d11-300ba23f52b0', 'volume_name': 'volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42ce2f1-f530-454e-92d7-4d0c94446f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42ce2f1-f530-454e-92d7-4d0c94446f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b821695-5bc8-4278-9237-f822893c0e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:18 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Volume c3e2f41b-f360-4eba-8d11-300ba23f52b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0', 'volume_size': 1}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1772864293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e2f41b-f360-4eba-8d11-300ba23f52b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:19Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Creating volume c3e2f41b-f360-4eba-8d11-300ba23f52b0 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:19 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:19 devstack sudo[85912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0 1073741824
Apr 13 18:44:19 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Flow 'volume_create_manager' (fc17398d-b2a6-4463-9891-cfb0ec43f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074f26be-65fb-4ea9-8840-c26c3eb66776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074f26be-65fb-4ea9-8840-c26c3eb66776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-807652046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bd7cceda-f9c0-4f00-95fb-56dacfa294bc,host='devstack@QuobyteHD#QuobyteHD',id=095a37c3-377e-4b19-a763-98138187363f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a66aca9b9944bd99f6253388dcf4ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:20Z,use_quota=True,user_id='0fb020ed7ed741638320cba846690b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98076ad7-50df-4849-91f7-f538725fab9e),volume_type_id=98076ad7-50df-4849-91f7-f538725fab9e)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33985f2-3e66-4de0-9e88-cd52d1bd3f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33985f2-3e66-4de0-9e88-cd52d1bd3f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d160b953-f685-436a-b18c-3a55b137b0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d160b953-f685-436a-b18c-3a55b137b0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095a37c3-377e-4b19-a763-98138187363f', 'volume_name': 'volume-095a37c3-377e-4b19-a763-98138187363f', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8973e6-86dd-4164-a5e8-6358868b17a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8973e6-86dd-4164-a5e8-6358868b17a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47df4ff0-f313-4103-b561-a4abe6b1b1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Volume 095a37c3-377e-4b19-a763-98138187363f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095a37c3-377e-4b19-a763-98138187363f', 'volume_size': 1}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:19 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0 1073741824" returned: 0 in 0.762s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:19 devstack sudo[85920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0
Apr 13 18:44:19 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:20 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0" returned: 0 in 0.500s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bd7cceda-f9c0-4f00-95fb-56dacfa294bc,created_at=2026-04-13T16:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-807652046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bd7cceda-f9c0-4f00-95fb-56dacfa294bc,host='devstack@QuobyteHD#QuobyteHD',id=095a37c3-377e-4b19-a763-98138187363f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a66aca9b9944bd99f6253388dcf4ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:20Z,use_quota=True,user_id='0fb020ed7ed741638320cba846690b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98076ad7-50df-4849-91f7-f538725fab9e),volume_type_id=98076ad7-50df-4849-91f7-f538725fab9e)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Creating volume 095a37c3-377e-4b19-a763-98138187363f {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:20 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b821695-5bc8-4278-9237-f822893c0e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73dec42-0291-4b8c-b60e-81af538f83f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:20 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Volume volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0 (c3e2f41b-f360-4eba-8d11-300ba23f52b0): created successfully
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73dec42-0291-4b8c-b60e-81af538f83f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:20 devstack sudo[85923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f 1073741824
Apr 13 18:44:20 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (aed99d7d-9e2e-4596-b405-9577e4901441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a575b64a-0f9a-4e78-9d3a-2e6c0a8bc00e tempest-VolumesActionsTest-1372463006 None] Created volume successfully.
Apr 13 18:44:21 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f 1073741824" returned: 0 in 0.724s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-75ef94a1-9209-4d98-8611-30973ed4c290 tempest-VolumesActionsTest-1372463006 None] Acquiring lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0" by "attach_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-75ef94a1-9209-4d98-8611-30973ed4c290 tempest-VolumesActionsTest-1372463006 None] Lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0" acquired by "attach_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:21 devstack sudo[85929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f
Apr 13 18:44:21 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-75ef94a1-9209-4d98-8611-30973ed4c290 tempest-VolumesActionsTest-1372463006 None] Attaching volume c3e2f41b-f360-4eba-8d11-300ba23f52b0 to instance 5c9ff100-2b40-47dd-aefc-5b233146b89a at mountpoint /dev/vdb on host None.
Apr 13 18:44:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-75ef94a1-9209-4d98-8611-30973ed4c290 tempest-VolumesActionsTest-1372463006 None] Attach volume completed successfully.
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-75ef94a1-9209-4d98-8611-30973ed4c290 tempest-VolumesActionsTest-1372463006 None] Lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0" released by "attach_volume" :: held 0.113s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:21 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f" returned: 0 in 0.533s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47df4ff0-f313-4103-b561-a4abe6b1b1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095a37c3-377e-4b19-a763-98138187363f', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dead01c-58eb-4c56-814f-0977327186cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:21 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Volume volume-095a37c3-377e-4b19-a763-98138187363f (095a37c3-377e-4b19-a763-98138187363f): created successfully
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dead01c-58eb-4c56-814f-0977327186cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Flow 'volume_create_manager' (fc17398d-b2a6-4463-9891-cfb0ec43f108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-583a2de9-1197-4b94-84cb-404205d9e9c1 tempest-GroupsTest-1541747043 None] Created volume successfully.
Apr 13 18:44:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-03e7568e-d866-45d7-a486-74c7a9282458 tempest-VolumesActionsTest-1211576750 None] Terminate volume connection completed successfully.
Apr 13 18:44:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Acquiring lock "cinder-quobyte-095a37c3-377e-4b19-a763-98138187363f" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Lock "cinder-quobyte-095a37c3-377e-4b19-a763-98138187363f" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:22 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e27744-6a05-4133-ba94-980ee64539c2]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:22 devstack sudo[85934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f
Apr 13 18:44:22 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-03e7568e-d866-45d7-a486-74c7a9282458 tempest-VolumesActionsTest-1211576750 None] Acquiring lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0-detach_volume" by "detach_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-03e7568e-d866-45d7-a486-74c7a9282458 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-03e7568e-d866-45d7-a486-74c7a9282458 tempest-VolumesActionsTest-1211576750 None] Detaching volume c3e2f41b-f360-4eba-8d11-300ba23f52b0 from instance 5c9ff100-2b40-47dd-aefc-5b233146b89a.
Apr 13 18:44:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-03e7568e-d866-45d7-a486-74c7a9282458 tempest-VolumesActionsTest-1211576750 None] Detach volume completed successfully.
Apr 13 18:44:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-03e7568e-d866-45d7-a486-74c7a9282458 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:22 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f" returned: 0 in 0.642s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:23 devstack sudo[85958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f
Apr 13 18:44:23 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8b680ab0-0611-41b1-b6c9-ed0f4e2ef9de tempest-VolumesActionsTest-1372463006 None] Acquiring lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0-detach_volume" by "detach_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8b680ab0-0611-41b1-b6c9-ed0f4e2ef9de tempest-VolumesActionsTest-1372463006 None] Lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-8b680ab0-0611-41b1-b6c9-ed0f4e2ef9de tempest-VolumesActionsTest-1372463006 None] Volume detach called, but volume not attached.
Apr 13 18:44:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8b680ab0-0611-41b1-b6c9-ed0f4e2ef9de tempest-VolumesActionsTest-1372463006 None] Lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:23 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-095a37c3-377e-4b19-a763-98138187363f" returned: 0 in 0.984s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Lock "cinder-quobyte-095a37c3-377e-4b19-a763-98138187363f" released by "delete_volume" :: held 1.653s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Created reservations ['aef2d7d2-02dc-485d-a182-6ac0d994c342'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:24 devstack cinder-volume[82517]: WARNING cinder.quota [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-776314856 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-776314856, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:44:24 devstack cinder-volume[82517]: WARNING cinder.quota [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-776314856 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-776314856, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Created reservations ['9bb9449b-b9a2-4dbd-acc9-8dbfc625f0fd', '73c0d042-c6e4-456b-910e-072545ce4df0', '0efbed55-29fe-432d-b320-cd93ae11d8cf', '76d4aa07-df07-4729-8ff0-60e940b33762'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:24 devstack sudo[85972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:24 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Acquiring lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Acquiring lock "cinder-quobyte-c3e2f41b-f360-4eba-8d11-300ba23f52b0" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Lock "cinder-quobyte-c3e2f41b-f360-4eba-8d11-300ba23f52b0" acquired by "delete_volume" :: waited 0.025s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeefaf27-8d93-4321-9e9f-6352609f0ee7]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:24 devstack sudo[85974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0
Apr 13 18:44:24 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:24 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] Created reservations ['c6ac659c-8e29-4d84-b049-e21a4c397f6a'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:25 devstack sudo[85976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:25 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:25 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 1.279s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:25 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d1dc5593-863d-432c-8cf3-55843d527466 tempest-GroupsTest-1541747043 None] Delete group completed successfully.
Apr 13 18:44:25 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0" returned: 0 in 1.120s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:25 devstack sudo[85984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0
Apr 13 18:44:25 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:26 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 1.160s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:26 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5d59387f-a969-42f2-92e8-321319edc95a tempest-GroupsTest-1541747043 None] Delete group completed successfully.
Apr 13 18:44:26 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-45a7b84e-562a-4eae-933d-69901606dd88 tempest-GroupsTest-1541747043 None] Group tempest-GroupsTest-Group-579737410: creating
Apr 13 18:44:26 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-45a7b84e-562a-4eae-933d-69901606dd88 tempest-GroupsTest-1541747043 None] Group tempest-GroupsTest-Group-579737410: created successfully
Apr 13 18:44:26 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-45a7b84e-562a-4eae-933d-69901606dd88 tempest-GroupsTest-1541747043 None] Create group completed successfully.
Apr 13 18:44:26 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c3e2f41b-f360-4eba-8d11-300ba23f52b0" returned: 0 in 1.056s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Lock "cinder-quobyte-c3e2f41b-f360-4eba-8d11-300ba23f52b0" released by "delete_volume" :: held 2.290s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Created reservations ['595ce559-bb61-4ab2-bf26-da0a374607cb', 'ed4a86e9-6a5e-4e50-83f1-5045aa439501', '1dcc2f98-f2ca-4725-a7a1-d3b25a6c8d1d', 'd29b811b-fd12-40d5-a958-8b07f533c13d'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:27 devstack sudo[85988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:27 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:27 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.682s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:27 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:27 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Deleted volume successfully.
Apr 13 18:44:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-427761e9-b154-4df8-96f2-3683c08085cd tempest-VolumesActionsTest-1372463006 None] Lock "cinder-c3e2f41b-f360-4eba-8d11-300ba23f52b0-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Flow 'volume_create_manager' (582d04b5-1c7e-48ee-9db9-b3e10fe25280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13fb199-01d5-4cf8-9f49-894ca878fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13fb199-01d5-4cf8-9f49-894ca878fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1054001658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=390d5e01-2012-4258-86c8-9d9e4ab5783e,host='devstack@QuobyteHD#QuobyteHD',id=57d56102-74fa-4410-9736-8a89529d02fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a66aca9b9944bd99f6253388dcf4ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:28Z,use_quota=True,user_id='0fb020ed7ed741638320cba846690b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb4ca517-bbf8-492f-9a73-9ac5d02fa310),volume_type_id=bb4ca517-bbf8-492f-9a73-9ac5d02fa310)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66854e92-3646-4465-ab98-cc5e6125d270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66854e92-3646-4465-ab98-cc5e6125d270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b44105d-488c-4076-a62b-81f4e930e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b44105d-488c-4076-a62b-81f4e930e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d56102-74fa-4410-9736-8a89529d02fa', 'volume_name': 'volume-57d56102-74fa-4410-9736-8a89529d02fa', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fc1bf2-e2ea-47b5-9565-7079f9bd7c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fc1bf2-e2ea-47b5-9565-7079f9bd7c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf6995e-9242-47ea-a838-0a142ca3a200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:28 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Volume 57d56102-74fa-4410-9736-8a89529d02fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d56102-74fa-4410-9736-8a89529d02fa', 'volume_size': 1}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=390d5e01-2012-4258-86c8-9d9e4ab5783e,created_at=2026-04-13T16:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1054001658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=390d5e01-2012-4258-86c8-9d9e4ab5783e,host='devstack@QuobyteHD#QuobyteHD',id=57d56102-74fa-4410-9736-8a89529d02fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a66aca9b9944bd99f6253388dcf4ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:28Z,use_quota=True,user_id='0fb020ed7ed741638320cba846690b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb4ca517-bbf8-492f-9a73-9ac5d02fa310),volume_type_id=bb4ca517-bbf8-492f-9a73-9ac5d02fa310)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Creating volume 57d56102-74fa-4410-9736-8a89529d02fa {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:28 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:28 devstack sudo[85992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa 1073741824
Apr 13 18:44:28 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:29 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa 1073741824" returned: 0 in 1.078s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:29 devstack sudo[86077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa
Apr 13 18:44:29 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:30 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa" returned: 0 in 0.707s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf6995e-9242-47ea-a838-0a142ca3a200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d56102-74fa-4410-9736-8a89529d02fa', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3157afb-8ec8-4032-8158-f95f64cbffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Volume volume-57d56102-74fa-4410-9736-8a89529d02fa (57d56102-74fa-4410-9736-8a89529d02fa): created successfully
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3157afb-8ec8-4032-8158-f95f64cbffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Flow 'volume_create_manager' (582d04b5-1c7e-48ee-9db9-b3e10fe25280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:30 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-1c1b2b85-c4ac-4090-b668-661183de81e2 tempest-GroupsTest-1541747043 None] Created volume successfully.
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Flow 'volume_create_manager' (4517408c-0fb8-4e79-9dd2-d478c4aaf4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a023f8-0928-4428-9700-3633c0a46e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a023f8-0928-4428-9700-3633c0a46e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-609406375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=390d5e01-2012-4258-86c8-9d9e4ab5783e,host='devstack@QuobyteHD#QuobyteHD',id=d3cab489-8fe9-4104-bb5e-7cca16d91c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a66aca9b9944bd99f6253388dcf4ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:31Z,use_quota=True,user_id='0fb020ed7ed741638320cba846690b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb4ca517-bbf8-492f-9a73-9ac5d02fa310),volume_type_id=bb4ca517-bbf8-492f-9a73-9ac5d02fa310)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cfcaa9-6324-48ae-9155-68f491b3b628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cfcaa9-6324-48ae-9155-68f491b3b628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523931c3-8584-4758-9069-0350c67e916d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523931c3-8584-4758-9069-0350c67e916d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3cab489-8fe9-4104-bb5e-7cca16d91c51', 'volume_name': 'volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fc9e45-9010-4cd6-b7b4-da1b58d6f7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fc9e45-9010-4cd6-b7b4-da1b58d6f7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62203ea7-20fa-4b97-b5f8-7acf985457d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Volume d3cab489-8fe9-4104-bb5e-7cca16d91c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51', 'volume_size': 1}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=390d5e01-2012-4258-86c8-9d9e4ab5783e,created_at=2026-04-13T16:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-609406375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=390d5e01-2012-4258-86c8-9d9e4ab5783e,host='devstack@QuobyteHD#QuobyteHD',id=d3cab489-8fe9-4104-bb5e-7cca16d91c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a66aca9b9944bd99f6253388dcf4ce9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:31Z,use_quota=True,user_id='0fb020ed7ed741638320cba846690b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb4ca517-bbf8-492f-9a73-9ac5d02fa310),volume_type_id=bb4ca517-bbf8-492f-9a73-9ac5d02fa310)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Creating volume d3cab489-8fe9-4104-bb5e-7cca16d91c51 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:30 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:30 devstack sudo[86084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51 1073741824
Apr 13 18:44:30 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:31 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51 1073741824" returned: 0 in 0.603s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:31 devstack sudo[86091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51
Apr 13 18:44:31 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:31 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51" returned: 0 in 0.466s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62203ea7-20fa-4b97-b5f8-7acf985457d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77d7101-c75f-4122-91c4-b031aa5b0750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:31 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Volume volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51 (d3cab489-8fe9-4104-bb5e-7cca16d91c51): created successfully
Apr 13 18:44:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77d7101-c75f-4122-91c4-b031aa5b0750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Flow 'volume_create_manager' (4517408c-0fb8-4e79-9dd2-d478c4aaf4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:31 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ac84fc65-95b7-45d6-a7d3-7394f00b12c3 tempest-GroupsTest-1541747043 None] Created volume successfully.
Apr 13 18:44:32 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d6676616-f863-4ed4-9fed-b1d35cc87eb5 tempest-GroupsTest-1541747043 None] Update group completed successfully.
Apr 13 18:44:34 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-fdf8c461-c94e-44d3-9935-d347e3e955db tempest-GroupsTest-1541747043 None] Update group completed successfully.
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (41fbebb3-5d8b-4a1a-8545-2a6294d78a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a355e55e-cbb1-4167-8420-afc4819b75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a355e55e-cbb1-4167-8420-afc4819b75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1335398099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32c2a73-5655-47ac-8d26-8ec2d885c052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:35Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a46ee32-36ef-4bd2-af70-f94fb31234e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a46ee32-36ef-4bd2-af70-f94fb31234e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e7d2d-c6c9-4c89-887f-5770811ef206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e7d2d-c6c9-4c89-887f-5770811ef206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32c2a73-5655-47ac-8d26-8ec2d885c052', 'volume_name': 'volume-c32c2a73-5655-47ac-8d26-8ec2d885c052', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539b40e6-086c-4c3a-8cc7-1db02bf3af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539b40e6-086c-4c3a-8cc7-1db02bf3af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e43c72f-9ee7-41fb-b4b9-162398db7c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:34 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Volume c32c2a73-5655-47ac-8d26-8ec2d885c052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32c2a73-5655-47ac-8d26-8ec2d885c052', 'volume_size': 1}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1335398099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32c2a73-5655-47ac-8d26-8ec2d885c052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:35Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Creating volume c32c2a73-5655-47ac-8d26-8ec2d885c052 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:34 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:34 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052 1073741824
Apr 13 18:44:34 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:35 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052 1073741824" returned: 0 in 0.622s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:35 devstack sudo[86106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052
Apr 13 18:44:35 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Acquiring lock "cinder-quobyte-57d56102-74fa-4410-9736-8a89529d02fa" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Lock "cinder-quobyte-57d56102-74fa-4410-9736-8a89529d02fa" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06cd3ba-6d40-45c3-b5ae-0a827061807b]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:35 devstack sudo[86108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa
Apr 13 18:44:35 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:35 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052" returned: 0 in 0.443s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e43c72f-9ee7-41fb-b4b9-162398db7c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32c2a73-5655-47ac-8d26-8ec2d885c052', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf9db3e-d9fa-4621-bbef-a456fb8afa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:35 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Volume volume-c32c2a73-5655-47ac-8d26-8ec2d885c052 (c32c2a73-5655-47ac-8d26-8ec2d885c052): created successfully
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf9db3e-d9fa-4621-bbef-a456fb8afa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (41fbebb3-5d8b-4a1a-8545-2a6294d78a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:35 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-0ac01d1e-b48d-4ce8-b4ce-d2d018ddd3eb tempest-VolumesActionsTest-1372463006 None] Created volume successfully.
Apr 13 18:44:35 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa" returned: 0 in 0.499s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:35 devstack sudo[86114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa
Apr 13 18:44:35 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:36 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57d56102-74fa-4410-9736-8a89529d02fa" returned: 0 in 0.500s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Lock "cinder-quobyte-57d56102-74fa-4410-9736-8a89529d02fa" released by "delete_volume" :: held 1.023s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Acquiring lock "cinder-quobyte-d3cab489-8fe9-4104-bb5e-7cca16d91c51" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Lock "cinder-quobyte-d3cab489-8fe9-4104-bb5e-7cca16d91c51" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:36 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[439afc09-0bd7-4758-81df-2d415105fdcc]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:36 devstack sudo[86124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51
Apr 13 18:44:36 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Acquiring lock "cinder-c32c2a73-5655-47ac-8d26-8ec2d885c052-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-c32c2a73-5655-47ac-8d26-8ec2d885c052-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Acquiring lock "cinder-quobyte-c32c2a73-5655-47ac-8d26-8ec2d885c052" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-quobyte-c32c2a73-5655-47ac-8d26-8ec2d885c052" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcc1d19-faba-403a-9fc1-9928ad74cebc]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:37 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51" returned: 0 in 0.623s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:37 devstack sudo[86129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052
Apr 13 18:44:37 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:37 devstack sudo[86130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51
Apr 13 18:44:37 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:37 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d3cab489-8fe9-4104-bb5e-7cca16d91c51" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Lock "cinder-quobyte-d3cab489-8fe9-4104-bb5e-7cca16d91c51" released by "delete_volume" :: held 1.164s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:37 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052" returned: 0 in 0.652s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:37 devstack sudo[86137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052
Apr 13 18:44:37 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Created reservations ['dd681ae8-394c-4aa7-8a3f-0d3b3c79cc61'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:37 devstack cinder-volume[82517]: WARNING cinder.quota [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1542864590 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1542864590, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:44:37 devstack cinder-volume[82517]: WARNING cinder.quota [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1542864590 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1542864590, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Created reservations ['f6204bbe-b683-48cf-9b87-f1b4691b0008', '5caff0dd-14b1-4b2f-85c9-c1a681555e48', '088b1683-00e5-4351-95f1-57bebb07e5d3', 'a015dfd7-f513-4b26-8798-2976462a5718'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Created reservations ['ad32e7e0-1e03-4034-9b49-f927d130c010', 'bfae016b-ac84-470d-bdcf-7a62ca77ab76', 'e8203a77-d646-4712-94e8-5658c0a5fd05', '80bc9507-8685-4c06-bb54-353ef8dc68c0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:37 devstack sudo[86139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:37 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:38 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c32c2a73-5655-47ac-8d26-8ec2d885c052" returned: 0 in 0.524s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-quobyte-c32c2a73-5655-47ac-8d26-8ec2d885c052" released by "delete_volume" :: held 1.203s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Created reservations ['f19cb48d-d42c-442c-bcd8-051f5c806008', 'bbf5b91e-be0a-4379-8d6b-0adabde76d84', 'e3d284ce-5c8f-4ba2-b190-e967e2a3e2b7', '79a56d69-c64e-4951-a423-2326b857a319'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:38 devstack sudo[86145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:38 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:38 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.614s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:38 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d081e067-c6b1-4290-825e-b8a1fa6e38b7 tempest-GroupsTest-1541747043 None] Delete group completed successfully.
Apr 13 18:44:38 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.519s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:38 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Deleted volume successfully.
Apr 13 18:44:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe558021-63e3-405d-b4aa-a8c74fd9c769 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-c32c2a73-5655-47ac-8d26-8ec2d885c052-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (ad108191-7d21-4727-b526-eca441cbe559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38118a15-de7b-4559-8d9f-bfb037c45a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38118a15-de7b-4559-8d9f-bfb037c45a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255503426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46177a0-e9b4-4d83-a356-bf43a47815ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:39Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f4925e-eab8-4113-8b50-36eaf00907e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f4925e-eab8-4113-8b50-36eaf00907e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c85ede-be0d-4b2b-b85d-28256ea76b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c85ede-be0d-4b2b-b85d-28256ea76b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46177a0-e9b4-4d83-a356-bf43a47815ed', 'volume_name': 'volume-c46177a0-e9b4-4d83-a356-bf43a47815ed', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408ec7c0-4e13-4c67-88dd-b9a721485f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408ec7c0-4e13-4c67-88dd-b9a721485f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f07b3c1-5bf7-4ceb-8911-606779407cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:39 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Volume c46177a0-e9b4-4d83-a356-bf43a47815ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46177a0-e9b4-4d83-a356-bf43a47815ed', 'volume_size': 1}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255503426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46177a0-e9b4-4d83-a356-bf43a47815ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:39Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Creating volume c46177a0-e9b4-4d83-a356-bf43a47815ed {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:39 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:39 devstack sudo[86163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed 1073741824
Apr 13 18:44:39 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:40 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed 1073741824" returned: 0 in 0.534s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:40 devstack sudo[86168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed
Apr 13 18:44:40 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:40 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed" returned: 0 in 0.578s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f07b3c1-5bf7-4ceb-8911-606779407cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46177a0-e9b4-4d83-a356-bf43a47815ed', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923a5d5b-03d6-45b1-bb3c-14b45e86e885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:40 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Volume volume-c46177a0-e9b4-4d83-a356-bf43a47815ed (c46177a0-e9b4-4d83-a356-bf43a47815ed): created successfully
Apr 13 18:44:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923a5d5b-03d6-45b1-bb3c-14b45e86e885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (ad108191-7d21-4727-b526-eca441cbe559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:40 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-fa946a0d-3e47-4bf8-af7a-a0c4741014d9 tempest-VolumesActionsTest-1372463006 None] Created volume successfully.
Apr 13 18:44:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Acquiring lock "cinder-c46177a0-e9b4-4d83-a356-bf43a47815ed-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-c46177a0-e9b4-4d83-a356-bf43a47815ed-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Acquiring lock "cinder-quobyte-c46177a0-e9b4-4d83-a356-bf43a47815ed" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-quobyte-c46177a0-e9b4-4d83-a356-bf43a47815ed" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:41 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[686070e3-4f19-4af3-ae79-f543357e5bf6]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:41 devstack sudo[86174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed
Apr 13 18:44:41 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:42 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed" returned: 0 in 0.607s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:42 devstack sudo[86179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed
Apr 13 18:44:42 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Flow 'volume_create_manager' (f7c370ec-26ca-4fe0-bb94-3166261b2656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645f7dd1-be87-4122-b6e2-50ffc70e2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645f7dd1-be87-4122-b6e2-50ffc70e2fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1692870547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed13e11-1c55-4de0-9037-b7769a53c0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353646157d47485d8ea2c98c7bc20e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:42Z,use_quota=True,user_id='3af73d5f4b774e1e99480fe14d670b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0cf289-91dc-4c93-9116-7b0986b4b49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0cf289-91dc-4c93-9116-7b0986b4b49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfab706d-be5f-499d-bd93-7028a8eacba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.image.glance [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Creating Keystone auth plugin from conf {{(pid=82517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfab706d-be5f-499d-bd93-7028a8eacba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ed13e11-1c55-4de0-9037-b7769a53c0bd', 'volume_name': 'volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0c16b7c0>}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b027b271-3553-4af8-a180-952126b9ce45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b027b271-3553-4af8-a180-952126b9ce45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fe3f66-b47a-4eb1-a299-cd054be52924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:42 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Volume 0ed13e11-1c55-4de0-9037-b7769a53c0bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0c16b7c0>}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Trying to clone 0ed13e11-1c55-4de0-9037-b7769a53c0bd from image e0058cc9-8f67-429f-9701-e23c6990051f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]). {{(pid=82517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 18:44:42 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c46177a0-e9b4-4d83-a356-bf43a47815ed" returned: 0 in 0.540s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-quobyte-c46177a0-e9b4-4d83-a356-bf43a47815ed" released by "delete_volume" :: held 1.178s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Created reservations ['d39c7855-aa05-4acd-b59b-a7bca4ccb9fd', 'a826e37c-6b61-4a2d-ab59-677922914b6e', '4fa8d081-5b6b-43ae-8a9c-9d21377b1062', 'bafeb7bc-cebe-4b47-8f98-eb184fbffb25'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:42 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 18:44:42 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[75257619-648c-4b8e-860c-738ca9666ac4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:43 devstack sudo[86204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:43 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:43 devstack sudo[86203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD
Apr 13 18:44:43 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:43 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD" returned: 0 in 0.811s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Temporary image e0058cc9-8f67-429f-9701-e23c6990051f is fetched for user 3af73d5f4b774e1e99480fe14d670b03. {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 18:44:43 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.844s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:43 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Deleted volume successfully.
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d789c24-4aa4-41b7-aa14-ef27dbf159b7]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4e5cb04e-e051-44bc-963b-86b6a6181bf2 tempest-VolumesActionsTest-1211576750 None] Lock "cinder-c46177a0-e9b4-4d83-a356-bf43a47815ed-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:44 devstack sudo[86240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD
Apr 13 18:44:44 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (2fd3cbd2-ca8c-4acf-90f8-8f8e39efcee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d087522-6ed4-4ffb-9684-1ba5480f622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d087522-6ed4-4ffb-9684-1ba5480f622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-116489591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04248a8b-d557-4ff5-bd28-2cda98caea4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:44Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64664828-96ca-4af4-9d60-adaa30d0c1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64664828-96ca-4af4-9d60-adaa30d0c1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6626a4d2-6b2e-4155-901c-d4ba889d8059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6626a4d2-6b2e-4155-901c-d4ba889d8059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04248a8b-d557-4ff5-bd28-2cda98caea4b', 'volume_name': 'volume-04248a8b-d557-4ff5-bd28-2cda98caea4b', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121d440c-7605-4130-9099-eacd695f95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121d440c-7605-4130-9099-eacd695f95ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527dbf82-07ce-4f50-9265-4017fae79aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:44 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Volume 04248a8b-d557-4ff5-bd28-2cda98caea4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04248a8b-d557-4ff5-bd28-2cda98caea4b', 'volume_size': 1}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-116489591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04248a8b-d557-4ff5-bd28-2cda98caea4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:44Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Creating volume 04248a8b-d557-4ff5-bd28-2cda98caea4b {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:44 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:44 devstack sudo[86243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b 1073741824
Apr 13 18:44:44 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:44 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD" returned: 0 in 0.790s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:45 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b 1073741824" returned: 0 in 0.675s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:45 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b
Apr 13 18:44:45 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:45 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b" returned: 0 in 0.449s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.906s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1692870547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed13e11-1c55-4de0-9037-b7769a53c0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353646157d47485d8ea2c98c7bc20e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:42Z,use_quota=True,user_id='3af73d5f4b774e1e99480fe14d670b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Creating volume 0ed13e11-1c55-4de0-9037-b7769a53c0bd {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:45 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527dbf82-07ce-4f50-9265-4017fae79aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04248a8b-d557-4ff5-bd28-2cda98caea4b', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f94f84-2928-4723-bcba-8df653630368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:45 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Volume volume-04248a8b-d557-4ff5-bd28-2cda98caea4b (04248a8b-d557-4ff5-bd28-2cda98caea4b): created successfully
Apr 13 18:44:45 devstack sudo[86254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd 1073741824
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f94f84-2928-4723-bcba-8df653630368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:45 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (2fd3cbd2-ca8c-4acf-90f8-8f8e39efcee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:45 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:45 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-955514c7-a3b0-4c11-abc0-835a1c0ca929 tempest-VolumesActionsTest-1372463006 None] Created volume successfully.
Apr 13 18:44:46 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd 1073741824" returned: 0 in 0.859s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Acquiring lock "cinder-04248a8b-d557-4ff5-bd28-2cda98caea4b-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:46 devstack sudo[86260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd
Apr 13 18:44:46 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Lock "cinder-04248a8b-d557-4ff5-bd28-2cda98caea4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Acquiring lock "cinder-quobyte-04248a8b-d557-4ff5-bd28-2cda98caea4b" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Lock "cinder-quobyte-04248a8b-d557-4ff5-bd28-2cda98caea4b" acquired by "delete_volume" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:46 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d5f55f-1b4d-402f-b517-1d1565a72ad3]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:46 devstack sudo[86262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b
Apr 13 18:44:46 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:47 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd" returned: 0 in 0.767s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Attempting download of e0058cc9-8f67-429f-9701-e23c6990051f ((None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}])) to volume 0ed13e11-1c55-4de0-9037-b7769a53c0bd. {{(pid=82517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb02969-721e-4521-9ee3-a953ced45efd]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0pysd8mj {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:47 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b" returned: 0 in 0.672s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:47 devstack sudo[86270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b
Apr 13 18:44:47 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:47 devstack sudo[86269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0pysd8mj
Apr 13 18:44:47 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:47 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-04248a8b-d557-4ff5-bd28-2cda98caea4b" returned: 0 in 0.438s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Lock "cinder-quobyte-04248a8b-d557-4ff5-bd28-2cda98caea4b" released by "delete_volume" :: held 1.214s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Created reservations ['54ed7668-1ccb-4169-b0c1-8f02d25ee9e0', 'f212e23b-4719-4cdb-95b7-f090918f409d', '6cad8cea-8dcb-4bcf-a0c1-bc4c75947839', '65324dbe-8e53-4afa-b49e-03ac7508addf'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:47 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0pysd8mj" returned: 0 in 0.635s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0pysd8mj {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:48 devstack sudo[86278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:48 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:48 devstack sudo[86279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0pysd8mj
Apr 13 18:44:48 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Flow 'volume_create_manager' (c829303c-0af6-4763-82d4-2d0acd1eb465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ecebd2-eba4-4ef4-9aee-09d53ff55a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ecebd2-eba4-4ef4-9aee-09d53ff55a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1281548541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b922ec-5249-41ee-80bd-0b82e9830d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3785ae986b894f2f9fe46358aa5c4856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:48Z,use_quota=True,user_id='45360f54198f451da2d86537f22ae948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e0b23e-8bc1-4898-a235-aa56eba02443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e0b23e-8bc1-4898-a235-aa56eba02443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e7ab08-4f23-40f0-ae07-ca1baf8803a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e7ab08-4f23-40f0-ae07-ca1baf8803a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b922ec-5249-41ee-80bd-0b82e9830d22', 'volume_name': 'volume-69b922ec-5249-41ee-80bd-0b82e9830d22', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8157dc88-7988-40d1-be0b-118056165ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8157dc88-7988-40d1-be0b-118056165ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9ba10b-2429-4658-815a-018996308f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:48 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Volume 69b922ec-5249-41ee-80bd-0b82e9830d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b922ec-5249-41ee-80bd-0b82e9830d22', 'volume_size': 1}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1281548541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b922ec-5249-41ee-80bd-0b82e9830d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3785ae986b894f2f9fe46358aa5c4856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:48Z,use_quota=True,user_id='45360f54198f451da2d86537f22ae948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Creating volume 69b922ec-5249-41ee-80bd-0b82e9830d22 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:48 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:48 devstack sudo[86282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22 1073741824
Apr 13 18:44:48 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:48 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.569s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:48 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Deleted volume successfully.
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b88584d2-2103-40ff-a4f2-b79289c0c98e tempest-VolumesActionsTest-1211576750 None] Lock "cinder-04248a8b-d557-4ff5-bd28-2cda98caea4b-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:48 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0pysd8mj" returned: 1 in 0.584s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0pysd8mj' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3c0beb-abaa-486f-b203-05a74fe9a741]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:48 devstack sudo[86287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD
Apr 13 18:44:48 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:48 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22 1073741824" returned: 0 in 0.590s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:49 devstack sudo[86292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22
Apr 13 18:44:49 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (6f7664af-a4e3-43da-afcc-f040a5570ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ad1f46-6f12-461d-8aff-810e2915fbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ad1f46-6f12-461d-8aff-810e2915fbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1853750678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098c510f-664b-481d-b305-25b449feab8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:49Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e20a5af-423a-457c-b323-fa41ce463714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e20a5af-423a-457c-b323-fa41ce463714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01df8349-f68b-4c9d-a87d-ab00e021ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01df8349-f68b-4c9d-a87d-ab00e021ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098c510f-664b-481d-b305-25b449feab8f', 'volume_name': 'volume-098c510f-664b-481d-b305-25b449feab8f', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc37e9e-5b62-4092-87d3-e37326938d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc37e9e-5b62-4092-87d3-e37326938d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e2cb30-084e-4397-b264-bb149e2dca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:49 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Volume 098c510f-664b-481d-b305-25b449feab8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098c510f-664b-481d-b305-25b449feab8f', 'volume_size': 1}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:49 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD" returned: 0 in 0.650s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] e0058cc9-8f67-429f-9701-e23c6990051f was qcow2, converting to raw {{(pid=82517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:49 devstack sudo[86297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd
Apr 13 18:44:49 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:49 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22" returned: 0 in 0.511s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1853750678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098c510f-664b-481d-b305-25b449feab8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:49Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Creating volume 098c510f-664b-481d-b305-25b449feab8f {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:49 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9ba10b-2429-4658-815a-018996308f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b922ec-5249-41ee-80bd-0b82e9830d22', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9940f2ba-1dcf-4c42-b095-6e55a97364a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:49 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f 1073741824
Apr 13 18:44:49 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:49 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Volume volume-69b922ec-5249-41ee-80bd-0b82e9830d22 (69b922ec-5249-41ee-80bd-0b82e9830d22): created successfully
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9940f2ba-1dcf-4c42-b095-6e55a97364a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Flow 'volume_create_manager' (c829303c-0af6-4763-82d4-2d0acd1eb465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a1ef6d61-bab5-46da-a7a0-bb8bda51bc8f tempest-VolumeQuotasAdminTestJSON-1404797949 None] Created volume successfully.
Apr 13 18:44:50 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f 1073741824" returned: 0 in 0.615s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:50 devstack sudo[86322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f
Apr 13 18:44:50 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:50 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd" returned: 0 in 1.165s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_adz2vcf_devstack@QuobyteHD, size 112.00 MB, duration 1.17 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:44:50 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Converted 112.00 MB image at 96.02 MB/s
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:50 devstack sudo[86327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd 1G
Apr 13 18:44:50 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Acquiring lock "cinder-69b922ec-5249-41ee-80bd-0b82e9830d22-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "cinder-69b922ec-5249-41ee-80bd-0b82e9830d22-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Acquiring lock "cinder-quobyte-69b922ec-5249-41ee-80bd-0b82e9830d22" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "cinder-quobyte-69b922ec-5249-41ee-80bd-0b82e9830d22" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a881b196-f7dd-4336-9276-76eace426346]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:50 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f" returned: 0 in 0.576s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e2cb30-084e-4397-b264-bb149e2dca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098c510f-664b-481d-b305-25b449feab8f', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf804f74-c8cb-4031-929b-3036ea467ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:50 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Volume volume-098c510f-664b-481d-b305-25b449feab8f (098c510f-664b-481d-b305-25b449feab8f): created successfully
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf804f74-c8cb-4031-929b-3036ea467ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (6f7664af-a4e3-43da-afcc-f040a5570ff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:50 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-baa7143c-aa68-4242-9df6-fc0c5400c8cd tempest-VolumesActionsTest-1372463006 None] Created volume successfully.
Apr 13 18:44:50 devstack sudo[86343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22
Apr 13 18:44:50 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:51 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd 1G" returned: 0 in 0.633s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28bcc2-def9-446a-9352-40dd91bc429b]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:51 devstack sudo[86359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd
Apr 13 18:44:51 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:51 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22" returned: 0 in 0.568s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:51 devstack sudo[86364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22
Apr 13 18:44:51 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Acquiring lock "cinder-098c510f-664b-481d-b305-25b449feab8f-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Lock "cinder-098c510f-664b-481d-b305-25b449feab8f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Acquiring lock "cinder-quobyte-098c510f-664b-481d-b305-25b449feab8f" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Lock "cinder-quobyte-098c510f-664b-481d-b305-25b449feab8f" acquired by "delete_volume" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[379b290a-5f32-4463-bf05-d754428fb75f]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:51 devstack sudo[86368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f
Apr 13 18:44:51 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:51 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-69b922ec-5249-41ee-80bd-0b82e9830d22" returned: 0 in 0.527s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "cinder-quobyte-69b922ec-5249-41ee-80bd-0b82e9830d22" released by "delete_volume" :: held 1.145s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:51 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd" returned: 0 in 0.756s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Created reservations ['0d6df8ea-62bc-46a8-b52b-e47a36f775b3', '5516f7d2-6edf-4d8f-b4b3-94970a02f941', '3d4a5758-b1c8-430f-9512-b67f5794cb5f', '384d04e1-0b2a-49e1-8d6f-16e407a253e2'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:51 devstack sudo[86371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd
Apr 13 18:44:51 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:51 devstack sudo[86373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:51 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:52 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f" returned: 0 in 0.885s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:52 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd" returned: 1 in 0.682s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Downloaded image e0058cc9-8f67-429f-9701-e23c6990051f ((None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}])) to volume 0ed13e11-1c55-4de0-9037-b7769a53c0bd successfully. {{(pid=82517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Temporary image e0058cc9-8f67-429f-9701-e23c6990051f for user 3af73d5f4b774e1e99480fe14d670b03 is deleted. {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Marking volume 0ed13e11-1c55-4de0-9037-b7769a53c0bd as bootable. {{(pid=82517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Copying metadata from image e0058cc9-8f67-429f-9701-e23c6990051f to 0ed13e11-1c55-4de0-9037-b7769a53c0bd. {{(pid=82517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Creating volume glance metadata for volume 0ed13e11-1c55-4de0-9037-b7769a53c0bd backed by image e0058cc9-8f67-429f-9701-e23c6990051f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 18:44:52 devstack sudo[86382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f
Apr 13 18:44:52 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:52 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fe3f66-b47a-4eb1-a299-cd054be52924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0c16b7c0>}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2b84ba-bea1-417d-9e72-97cdc8418de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.639s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:52 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Deleted volume successfully.
Apr 13 18:44:52 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Volume volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd (0ed13e11-1c55-4de0-9037-b7769a53c0bd): created successfully
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2b84ba-bea1-417d-9e72-97cdc8418de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Flow 'volume_create_manager' (f7c370ec-26ca-4fe0-bb94-3166261b2656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:52 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a9018bf5-5a0d-4403-8f2b-8aa7cbfee841 tempest-VolumesImageMetadata-1631779738 None] Created volume successfully.
Apr 13 18:44:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6e107de1-f4bb-4979-988c-32a828cdcc5d tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "cinder-69b922ec-5249-41ee-80bd-0b82e9830d22-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:53 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-098c510f-664b-481d-b305-25b449feab8f" returned: 0 in 0.542s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Lock "cinder-quobyte-098c510f-664b-481d-b305-25b449feab8f" released by "delete_volume" :: held 1.480s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Created reservations ['71a12c4b-a521-408a-8315-2cfdb828cfa7', 'ff6d7462-7ada-41a1-8973-6159c67f463b', '060417e9-1190-4366-99fd-c4e2ead8e344', '75a4ce89-ad29-4cd8-9903-260cbc4b58f0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Flow 'volume_create_manager' (aad1b0b8-6b5f-474c-940e-17772b087a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:53 devstack sudo[86385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1721f0bc-2d90-4b17-938a-0fda83c071b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:53 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1721f0bc-2d90-4b17-938a-0fda83c071b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-568312319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac9326d-2b67-4791-bafc-f5c6fcf96a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3785ae986b894f2f9fe46358aa5c4856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:53Z,use_quota=True,user_id='45360f54198f451da2d86537f22ae948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df5ad4d-9d3a-413e-a867-008dc2c98025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df5ad4d-9d3a-413e-a867-008dc2c98025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34249d1a-c258-45e4-9ef9-d5853583a3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34249d1a-c258-45e4-9ef9-d5853583a3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac9326d-2b67-4791-bafc-f5c6fcf96a47', 'volume_name': 'volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2910fb84-9dcf-46e0-9f87-141bd1669d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2910fb84-9dcf-46e0-9f87-141bd1669d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c8bebd-98a3-461e-bbf6-93e146712c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:53 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Volume 3ac9326d-2b67-4791-bafc-f5c6fcf96a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47', 'volume_size': 1}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-568312319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac9326d-2b67-4791-bafc-f5c6fcf96a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3785ae986b894f2f9fe46358aa5c4856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:53Z,use_quota=True,user_id='45360f54198f451da2d86537f22ae948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Creating volume 3ac9326d-2b67-4791-bafc-f5c6fcf96a47 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:53 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:53 devstack sudo[86387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47 1073741824
Apr 13 18:44:53 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Acquiring lock "cinder-0ed13e11-1c55-4de0-9037-b7769a53c0bd-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Lock "cinder-0ed13e11-1c55-4de0-9037-b7769a53c0bd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Acquiring lock "cinder-quobyte-0ed13e11-1c55-4de0-9037-b7769a53c0bd" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Lock "cinder-quobyte-0ed13e11-1c55-4de0-9037-b7769a53c0bd" acquired by "delete_volume" :: waited 0.023s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[638fa4ee-3077-4ac0-a3f1-c94c39500450]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:53 devstack sudo[86390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd
Apr 13 18:44:53 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:54 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (c265428d-9863-49d7-8570-d1daa961cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7ff453-1f50-41e2-87bd-c09b8a33d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.903s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7ff453-1f50-41e2-87bd-c09b8a33d336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298462452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3db01e7-0d16-4d68-841c-6251a4fd3006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:54Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290aa7cd-6c3f-4f42-b31e-e899c6d786af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:54 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290aa7cd-6c3f-4f42-b31e-e899c6d786af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df561566-630d-4ab3-b191-102eeae98623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df561566-630d-4ab3-b191-102eeae98623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3db01e7-0d16-4d68-841c-6251a4fd3006', 'volume_name': 'volume-b3db01e7-0d16-4d68-841c-6251a4fd3006', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3381a77-03d1-4f53-9552-bfe7681522e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3381a77-03d1-4f53-9552-bfe7681522e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69c2988-f150-4f70-a67a-64f450d8302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:54 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Volume b3db01e7-0d16-4d68-841c-6251a4fd3006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3db01e7-0d16-4d68-841c-6251a4fd3006', 'volume_size': 1}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:54 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Deleted volume successfully.
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47 1073741824" returned: 0 in 0.838s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3cea8ec4-0028-4c1f-b9ad-a93de681eb4b tempest-VolumesActionsTest-1211576750 None] Lock "cinder-098c510f-664b-481d-b305-25b449feab8f-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:54 devstack sudo[86396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47
Apr 13 18:44:54 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:54 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd" returned: 0 in 0.589s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:54 devstack sudo[86400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd
Apr 13 18:44:54 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:54 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47" returned: 0 in 0.424s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-298462452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3db01e7-0d16-4d68-841c-6251a4fd3006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2d3f50327448eda7b140ba49b9e91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:54Z,use_quota=True,user_id='3067e0c6ad7242ad9854243b22a18a95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Creating volume b3db01e7-0d16-4d68-841c-6251a4fd3006 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:54 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=161,cinder:INSERT=35,cinder:UPDATE=156,cinder:DELETE=9 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c8bebd-98a3-461e-bbf6-93e146712c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:54 devstack sudo[86403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006 1073741824
Apr 13 18:44:54 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b2bc7f-f3ff-4eba-a959-7cd10e6b5b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=135,cinder:UPDATE=179,cinder:DELETE=12,cinder:INSERT=51 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:44:54 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Volume volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47 (3ac9326d-2b67-4791-bafc-f5c6fcf96a47): created successfully
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b2bc7f-f3ff-4eba-a959-7cd10e6b5b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Flow 'volume_create_manager' (aad1b0b8-6b5f-474c-940e-17772b087a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:54 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2eabb19e-f727-47c3-ae61-22bf102ba3f2 tempest-VolumeQuotasAdminTestJSON-1404797949 None] Created volume successfully.
Apr 13 18:44:54 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd" returned: 1 in 0.510s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:44:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:54 devstack sudo[86408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd
Apr 13 18:44:54 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:55 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006 1073741824" returned: 0 in 0.698s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:55 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006
Apr 13 18:44:55 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:55 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0ed13e11-1c55-4de0-9037-b7769a53c0bd" returned: 0 in 0.641s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Lock "cinder-quobyte-0ed13e11-1c55-4de0-9037-b7769a53c0bd" released by "delete_volume" :: held 1.809s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Created reservations ['a5916d1e-83f9-4a58-bcbb-aa459bae154c', 'a7568d3b-1344-4fb2-8f9a-4b1e2c8b0a3f', '2a7adf83-aff7-4cc1-98fb-c6feb6082bb0', '3746f7d9-5d48-45fc-b56d-15d0baf66b94'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:55 devstack sudo[86419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:55 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:55 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9951f730-1bde-435f-8b75-a267a0a5c5b5 tempest-VolumeQuotasAdminTestJSON-1996699088 None] Transfer volume completed successfully.
Apr 13 18:44:56 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006" returned: 0 in 0.764s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69c2988-f150-4f70-a67a-64f450d8302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3db01e7-0d16-4d68-841c-6251a4fd3006', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b84408-06e5-4ea3-839f-5bf183dd012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:56 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Volume volume-b3db01e7-0d16-4d68-841c-6251a4fd3006 (b3db01e7-0d16-4d68-841c-6251a4fd3006): created successfully
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b84408-06e5-4ea3-839f-5bf183dd012e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Flow 'volume_create_manager' (c265428d-9863-49d7-8570-d1daa961cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-733ac882-6145-4a64-85b3-61c1ad4d7c5a tempest-VolumesActionsTest-1372463006 None] Created volume successfully.
Apr 13 18:44:56 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.668s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Deleted volume successfully.
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4efb7c02-156d-4eea-9e76-8992b8d5216f tempest-VolumesImageMetadata-1631779738 None] Lock "cinder-0ed13e11-1c55-4de0-9037-b7769a53c0bd-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Acquiring lock "cinder-3ac9326d-2b67-4791-bafc-f5c6fcf96a47-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Lock "cinder-3ac9326d-2b67-4791-bafc-f5c6fcf96a47-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Acquiring lock "cinder-quobyte-3ac9326d-2b67-4791-bafc-f5c6fcf96a47" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Lock "cinder-quobyte-3ac9326d-2b67-4791-bafc-f5c6fcf96a47" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6557f791-c510-4283-aff0-c476d2528c38]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:56 devstack sudo[86424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47
Apr 13 18:44:56 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:57 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47" returned: 0 in 0.645s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:57 devstack sudo[86429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47
Apr 13 18:44:57 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Acquiring lock "cinder-b3db01e7-0d16-4d68-841c-6251a4fd3006-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Lock "cinder-b3db01e7-0d16-4d68-841c-6251a4fd3006-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Acquiring lock "cinder-quobyte-b3db01e7-0d16-4d68-841c-6251a4fd3006" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:44:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Lock "cinder-quobyte-b3db01e7-0d16-4d68-841c-6251a4fd3006" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:44:57 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d02b89d-dc13-43fd-bcfa-b205186f908c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:44:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:58 devstack sudo[86431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006
Apr 13 18:44:58 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:58 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3ac9326d-2b67-4791-bafc-f5c6fcf96a47" returned: 0 in 0.659s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Lock "cinder-quobyte-3ac9326d-2b67-4791-bafc-f5c6fcf96a47" released by "delete_volume" :: held 1.345s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Flow 'volume_create_manager' (f65cd653-77a5-473a-b023-34f90491e44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40682f25-e7db-4864-b09a-ece32d9fe8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40682f25-e7db-4864-b09a-ece32d9fe8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-383884877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa7177e-4ef4-4d74-b6df-acc08ba0fab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0178516a216c42e2aa02e01ece6382f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:58Z,use_quota=True,user_id='548a5c5ce2ab45d1902de4e42718cf11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c41ac1a-e6e5-4032-bcb6-9dfdb90b94f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c41ac1a-e6e5-4032-bcb6-9dfdb90b94f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f99043-7e23-4d3c-872e-1ac222ede85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f99043-7e23-4d3c-872e-1ac222ede85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa7177e-4ef4-4d74-b6df-acc08ba0fab1', 'volume_name': 'volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4010a630-be47-4692-b496-e1273cd63d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4010a630-be47-4692-b496-e1273cd63d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61021349-998b-424c-9e2b-50bafd76f0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:58 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Volume 3aa7177e-4ef4-4d74-b6df-acc08ba0fab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1', 'volume_size': 1}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-383884877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa7177e-4ef4-4d74-b6df-acc08ba0fab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0178516a216c42e2aa02e01ece6382f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:44:58Z,use_quota=True,user_id='548a5c5ce2ab45d1902de4e42718cf11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Creating volume 3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:44:58 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:58 devstack sudo[86434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 1073741824
Apr 13 18:44:58 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Created reservations ['9c5da46c-a8bb-44da-9455-3117946924ff', '7bd17213-3fa6-4843-a990-a6624e419ce7', 'b12f7e90-23d4-49e2-b5b3-2fe16ea9ddc8', '07581d7e-5273-4c81-8cf3-6ce9b45f278b'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:58 devstack sudo[86436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:58 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:58 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006" returned: 0 in 0.668s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:58 devstack sudo[86441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006
Apr 13 18:44:58 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:58 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.476s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:58 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Deleted volume successfully.
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8c4e7e04-0c21-435f-9026-220e21c8c31e tempest-VolumeQuotasAdminTestJSON-307388726 None] Lock "cinder-3ac9326d-2b67-4791-bafc-f5c6fcf96a47-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:58 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 1073741824" returned: 0 in 0.581s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:58 devstack sudo[86447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1
Apr 13 18:44:58 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:59 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b3db01e7-0d16-4d68-841c-6251a4fd3006" returned: 0 in 0.529s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Lock "cinder-quobyte-b3db01e7-0d16-4d68-841c-6251a4fd3006" released by "delete_volume" :: held 1.237s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Created reservations ['e391a1d4-5121-49f6-a9e1-93463a605427', '13451185-0dcd-4084-be5c-6d53b54f1093', '916723cc-49b3-4655-8fc9-b2d8359a7116', 'a498c8e2-9818-4fc6-8cf7-8f26d149b747'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:44:59 devstack sudo[86450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:44:59 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:44:59 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" returned: 0 in 0.596s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61021349-998b-424c-9e2b-50bafd76f0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dccc5334-96a8-4f1d-9387-e1b95ce293f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:44:59 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Volume volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 (3aa7177e-4ef4-4d74-b6df-acc08ba0fab1): created successfully
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dccc5334-96a8-4f1d-9387-e1b95ce293f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Flow 'volume_create_manager' (f65cd653-77a5-473a-b023-34f90491e44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:44:59 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b8c4b538-e8c2-485f-aa0d-b7d8fd935745 tempest-SnapshotMetadataTestJSON-1737008574 None] Created volume successfully.
Apr 13 18:44:59 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.494s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:44:59 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Deleted volume successfully.
Apr 13 18:44:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89942ceb-60f2-423f-8ebf-8875a05111bc tempest-VolumesActionsTest-1372463006 None] Lock "cinder-b3db01e7-0d16-4d68-841c-6251a4fd3006-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Creating offline snapshot 278c10ff-5036-4b77-89fa-5c9739b1a5bb of volume 3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c1ac6d-172a-456f-96e5-0f71251609ff]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:00 devstack sudo[86454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1
Apr 13 18:45:00 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG oslo_service.periodic_task [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:00 devstack sudo[86456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:00 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:01 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" returned: 0 in 0.829s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:01 devstack sudo[86461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb 1G
Apr 13 18:45:01 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:01 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.711s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Flow 'volume_create_manager' (6cb3c852-38c5-4d78-aa79-0673b4bcc33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d5b955-fa74-40bb-b5b0-6996f8c7c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d5b955-fa74-40bb-b5b0-6996f8c7c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:02Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd7c91c-b3b0-4fed-891b-15663e8e476b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fae38ae5a54b5da46dc562a5ca7e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:02Z,use_quota=True,user_id='f659ae901d8c40d390c0044ad5c0c982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430c4400-6db4-4750-bf73-3d2c38a7d1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430c4400-6db4-4750-bf73-3d2c38a7d1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:02 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4845ae16-bdc4-47d8-aec8-8a18a1f382eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.image.glance [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Creating Keystone auth plugin from conf {{(pid=82517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb 1G" returned: 0 in 1.029s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:02 devstack sudo[86469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb
Apr 13 18:45:02 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4845ae16-bdc4-47d8-aec8-8a18a1f382eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ebd7c91c-b3b0-4fed-891b-15663e8e476b', 'volume_name': 'volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0bfafb80>}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6657dfbd-499a-42a5-acdf-a3f1e77f9cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6657dfbd-499a-42a5-acdf-a3f1e77f9cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8c5755-bd3f-4778-9fa1-97124bd6a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:02 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Volume ebd7c91c-b3b0-4fed-891b-15663e8e476b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0bfafb80>}
Apr 13 18:45:02 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Trying to clone ebd7c91c-b3b0-4fed-891b-15663e8e476b from image e0058cc9-8f67-429f-9701-e23c6990051f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]). {{(pid=82517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 18:45:03 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 18:45:03 devstack cinder-volume[82517]: INFO cinder.image.image_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 18:45:03 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd8cb83-2e1c-4690-88fe-c34e0f1fdd74]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:03 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb" returned: 0 in 0.840s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:03 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb is being set with open permissions: ugo+rw
Apr 13 18:45:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:03 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb
Apr 13 18:45:03 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:03 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD
Apr 13 18:45:03 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:03 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb" returned: 0 in 0.559s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:03 devstack sudo[86483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.info
Apr 13 18:45:03 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:03 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:03 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Temporary image e0058cc9-8f67-429f-9701-e23c6990051f is fetched for user f659ae901d8c40d390c0044ad5c0c982. {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 18:45:04 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8619b21-6f80-4475-8bd8-687b66f13f79]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:04 devstack sudo[86488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD
Apr 13 18:45:04 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:04 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.info" returned: 0 in 0.643s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:04 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.info is being set with open permissions: ugo+rw
Apr 13 18:45:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:04 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.info
Apr 13 18:45:04 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:05 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD" returned: 0 in 0.948s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:05 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.info" returned: 0 in 0.852s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.852s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:02Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd7c91c-b3b0-4fed-891b-15663e8e476b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fae38ae5a54b5da46dc562a5ca7e13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:02Z,use_quota=True,user_id='f659ae901d8c40d390c0044ad5c0c982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Creating volume ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:05 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-dd44aa2f-71c6-40b5-b4d5-3ee986b952a2 tempest-SnapshotMetadataTestJSON-1737008574 None] Create snapshot completed successfully
Apr 13 18:45:05 devstack sudo[86506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b 1073741824
Apr 13 18:45:05 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:06 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b 1073741824" returned: 0 in 1.094s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:06 devstack sudo[86512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b
Apr 13 18:45:06 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Acquiring lock "cinder-278c10ff-5036-4b77-89fa-5c9739b1a5bb-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-278c10ff-5036-4b77-89fa-5c9739b1a5bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Acquiring lock "cinder-quobyte-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-quobyte-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Acquiring lock "cinder-quobyte-278c10ff-5036-4b77-89fa-5c9739b1a5bb" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-quobyte-278c10ff-5036-4b77-89fa-5c9739b1a5bb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Deleting offline snapshot 278c10ff-5036-4b77-89fa-5c9739b1a5bb of volume 3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] snapshot_file for this snap is: volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c234024-e38c-4012-851d-06c92fdfc5a1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:06 devstack sudo[86514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb
Apr 13 18:45:06 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:07 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b" returned: 0 in 0.922s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Attempting download of e0058cc9-8f67-429f-9701-e23c6990051f ((None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}])) to volume ebd7c91c-b3b0-4fed-891b-15663e8e476b. {{(pid=82517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0a5eca-ee3f-41e6-8f29-6d309574d966]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_cwazpfg1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:07 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb" returned: 0 in 0.822s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d627a82-a43b-465b-87a4-15c04ce2ed8c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:07 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_cwazpfg1
Apr 13 18:45:07 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:07 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1
Apr 13 18:45:07 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Flow 'volume_create_manager' (e4f2ae5b-e125-4abf-9ec6-516895cc99de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b287bc1-a3c3-47f9-b4a3-7506eed7ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b287bc1-a3c3-47f9-b4a3-7506eed7ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-899920110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee930ead2e1a488c9560c833ed1a7412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:08Z,use_quota=True,user_id='33e400cd5fe241b2805c2fa2dd296f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3515b044-49b4-48b8-b872-83e5dcac60eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3515b044-49b4-48b8-b872-83e5dcac60eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2ad86c-ac46-43e4-9c19-6b8dcbcee4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2ad86c-ac46-43e4-9c19-6b8dcbcee4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283', 'volume_name': 'volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c179b7-cb62-44b5-a182-bbc2bf858932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c179b7-cb62-44b5-a182-bbc2bf858932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7161945e-7b6d-46a0-ab34-45b169d586ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:08 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Volume ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283', 'volume_size': 1}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-899920110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee930ead2e1a488c9560c833ed1a7412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:08Z,use_quota=True,user_id='33e400cd5fe241b2805c2fa2dd296f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Creating volume ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:08 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:08 devstack sudo[86525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283 1073741824
Apr 13 18:45:08 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:08 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_cwazpfg1" returned: 0 in 0.884s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_cwazpfg1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:08 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" returned: 0 in 0.825s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:08 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb
Apr 13 18:45:08 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:08 devstack sudo[86532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_cwazpfg1
Apr 13 18:45:08 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:09 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:09 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283 1073741824" returned: 0 in 1.058s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_cwazpfg1" returned: 1 in 0.756s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_cwazpfg1' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c05731-bebe-4943-a6c7-008ca01a8966]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:09 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb" returned: 0 in 0.784s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:09 devstack sudo[86545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283
Apr 13 18:45:09 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:09 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb
Apr 13 18:45:09 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:09 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD
Apr 13 18:45:09 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:09 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283" returned: 0 in 0.550s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7161945e-7b6d-46a0-ab34-45b169d586ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939dd36d-126d-4af8-b38b-e951c872d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:09 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Volume volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283 (ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283): created successfully
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939dd36d-126d-4af8-b38b-e951c872d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Flow 'volume_create_manager' (e4f2ae5b-e125-4abf-9ec6-516895cc99de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:09 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bf3c1f31-90e0-4f13-8373-2143aaf5ad26 tempest-VolumesServicesTestJSON-1272867054 None] Created volume successfully.
Apr 13 18:45:09 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1.278c10ff-5036-4b77-89fa-5c9739b1a5bb" returned: 0 in 0.607s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-quobyte-278c10ff-5036-4b77-89fa-5c9739b1a5bb" released by "_delete_snapshot" :: held 3.144s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-quobyte-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" released by "delete_snapshot" :: held 3.168s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:09 devstack cinder-volume[82517]: WARNING cinder.quota [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Created reservations ['d6fab553-af8f-446f-b0f0-8505e592a51a', '7f09c86b-21b5-46cc-b048-2bff0bd6a982', '651c7fce-968b-4a5f-9925-b41f1ade7b21', '36813562-3d1f-4044-9e5e-c60b4bd5e744'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:09 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Delete snapshot completed successfully.
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-296fc3fe-4bff-4588-9f99-0a39aba70cb1 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-278c10ff-5036-4b77-89fa-5c9739b1a5bb-delete_snapshot" released by "delete_snapshot" :: held 3.287s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:09 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD" returned: 0 in 0.819s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] e0058cc9-8f67-429f-9701-e23c6990051f was qcow2, converting to raw {{(pid=82517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 18:45:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:10 devstack sudo[86555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b
Apr 13 18:45:10 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Acquiring lock "cinder-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Lock "cinder-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Acquiring lock "cinder-quobyte-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Lock "cinder-quobyte-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283" acquired by "delete_volume" :: waited 0.032s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:10 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a172aedb-2114-4ed5-9a59-839e4d498b8c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:10 devstack sudo[86558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283
Apr 13 18:45:10 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Acquiring lock "cinder-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Acquiring lock "cinder-quobyte-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-quobyte-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e6cde7-633f-4f75-acec-ea05bba51726]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:11 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Flow 'volume_create_manager' (42d2adcf-8ae7-42f5-afa9-04f2530b3ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a9d888-17e2-47d1-8d3f-1cd86fdada39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283" returned: 0 in 0.893s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a9d888-17e2-47d1-8d3f-1cd86fdada39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-399785496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab56320-07db-47da-9c2c-c2c4d5ce085c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e908c20fd540a4bfaf39857defa6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:11Z,use_quota=True,user_id='9101f1e514094d97babec521e2abddf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423d525f-0c67-4682-a281-78504d41b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:11 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1
Apr 13 18:45:11 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423d525f-0c67-4682-a281-78504d41b538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:11 devstack sudo[86593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283
Apr 13 18:45:11 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322866a4-92ee-415f-8ab0-615f240c1491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322866a4-92ee-415f-8ab0-615f240c1491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab56320-07db-47da-9c2c-c2c4d5ce085c', 'volume_name': 'volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815c62f4-2a37-4270-9063-32d4a1b0d786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815c62f4-2a37-4270-9063-32d4a1b0d786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5668fd6c-f519-460c-a072-5cdf2d8bd8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:11 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Volume 1ab56320-07db-47da-9c2c-c2c4d5ce085c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c', 'volume_size': 1}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-399785496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab56320-07db-47da-9c2c-c2c4d5ce085c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e908c20fd540a4bfaf39857defa6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:11Z,use_quota=True,user_id='9101f1e514094d97babec521e2abddf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Creating volume 1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:11 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:11 devstack sudo[86598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c 1073741824
Apr 13 18:45:11 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:11 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b" returned: 0 in 1.524s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_c0mxkl0pdevstack@QuobyteHD, size 112.00 MB, duration 1.53 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:45:11 devstack cinder-volume[82517]: INFO cinder.image.image_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Converted 112.00 MB image at 73.43 MB/s
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:11 devstack sudo[86601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b 1G
Apr 13 18:45:11 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:11 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283" returned: 0 in 0.759s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Lock "cinder-quobyte-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283" released by "delete_volume" :: held 1.681s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Created reservations ['0b45a812-4182-427a-9400-a23d59bb82f2', '5c05c814-11db-4015-baeb-4d21c8c07849', 'd938e36f-c49d-4689-880f-384059ec559c', 'af17eef9-301e-4e12-bd7f-c307a3046cc4'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:12 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" returned: 0 in 0.930s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:12 devstack sudo[86610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1
Apr 13 18:45:12 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:12 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c 1073741824" returned: 0 in 0.816s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:12 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:12 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:12 devstack sudo[86617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c
Apr 13 18:45:12 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:12 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b 1G" returned: 0 in 0.759s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d98844-6845-4d95-af06-9e75befc0295]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:12 devstack sudo[86619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b
Apr 13 18:45:12 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:12 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" returned: 0 in 0.825s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-quobyte-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1" released by "delete_volume" :: held 1.799s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Created reservations ['9eb1b88d-9574-4fb9-86e4-bdaaf5ca431f', '9d553d51-48af-4f27-b9ac-a596aa93c1aa', '5b2b0e7f-f796-4c06-988e-f0fa5007ac68', 'e44bf4ab-fd7f-4044-aad6-fbc456563790'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:12 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c" returned: 0 in 0.774s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5668fd6c-f519-460c-a072-5cdf2d8bd8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4e94b0-5064-40cc-b354-b454e0b67ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:13 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Volume volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c (1ab56320-07db-47da-9c2c-c2c4d5ce085c): created successfully
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4e94b0-5064-40cc-b354-b454e0b67ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Flow 'volume_create_manager' (42d2adcf-8ae7-42f5-afa9-04f2530b3ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:13 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b" returned: 0 in 0.808s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:13 devstack sudo[86632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:13 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-cda28f47-c6a9-4f50-806e-b0626bd7aebb tempest-VolumesDeleteCascade-232177248 None] Created volume successfully.
Apr 13 18:45:13 devstack sudo[86634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b
Apr 13 18:45:13 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:13 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 1.194s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Deleted volume successfully.
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-02b2658c-8153-4ef1-ade8-54260a436a7b tempest-VolumesServicesTestJSON-1272867054 None] Lock "cinder-ef3ea41e-cb3f-4bcf-8dce-2ad81a1ae283-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Creating offline snapshot 8e897259-f068-423a-ade8-37f150e5f34c of volume 1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2d4993-cb26-4fcb-af11-fd7566d24158]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:13 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.795s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Deleted volume successfully.
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0dd5c99e-2ffa-407a-bea9-d33ba205b571 tempest-SnapshotMetadataTestJSON-1737008574 None] Lock "cinder-3aa7177e-4ef4-4d74-b6df-acc08ba0fab1-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:13 devstack sudo[86638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c
Apr 13 18:45:13 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:13 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b" returned: 1 in 0.874s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Downloaded image e0058cc9-8f67-429f-9701-e23c6990051f ((None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}])) to volume ebd7c91c-b3b0-4fed-891b-15663e8e476b successfully. {{(pid=82517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Temporary image e0058cc9-8f67-429f-9701-e23c6990051f for user f659ae901d8c40d390c0044ad5c0c982 is deleted. {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Marking volume ebd7c91c-b3b0-4fed-891b-15663e8e476b as bootable. {{(pid=82517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Copying metadata from image e0058cc9-8f67-429f-9701-e23c6990051f to ebd7c91c-b3b0-4fed-891b-15663e8e476b. {{(pid=82517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 18:45:13 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Creating volume glance metadata for volume ebd7c91c-b3b0-4fed-891b-15663e8e476b backed by image e0058cc9-8f67-429f-9701-e23c6990051f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 18:45:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8c5755-bd3f-4778-9fa1-97124bd6a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0bfafb80>}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33829fd-2cc1-4977-87ef-9ac573c68daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:14 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Volume volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b (ebd7c91c-b3b0-4fed-891b-15663e8e476b): created successfully
Apr 13 18:45:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33829fd-2cc1-4977-87ef-9ac573c68daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Flow 'volume_create_manager' (6cb3c852-38c5-4d78-aa79-0673b4bcc33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:14 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-0fbacf9b-3096-4f33-aeb0-a4400f930a20 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Created volume successfully.
Apr 13 18:45:14 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c" returned: 0 in 1.066s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:14 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c 1G
Apr 13 18:45:14 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:15 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c 1G" returned: 0 in 0.630s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:15 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c
Apr 13 18:45:15 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:16 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c" returned: 0 in 0.653s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:16 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c is being set with open permissions: ugo+rw
Apr 13 18:45:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:16 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c
Apr 13 18:45:16 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:16 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c" returned: 0 in 0.584s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:16 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.info
Apr 13 18:45:16 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Flow 'volume_create_manager' (f53438f0-3f27-4319-af66-0f6b99ed79e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d350ebe2-ba72-4158-a58e-f11f379a18f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d350ebe2-ba72-4158-a58e-f11f379a18f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1178782308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e967a6b-102f-4ef9-96b9-b1135bd3db86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06fcf6f2d07477caeef620e3c50b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:17Z,use_quota=True,user_id='759f022891524f8b8559109bd1d7efcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc2f07f-e185-4710-b9af-2b4830b01973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc2f07f-e185-4710-b9af-2b4830b01973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3d3261-1ef3-4fd0-8b3a-e77e9398a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3d3261-1ef3-4fd0-8b3a-e77e9398a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e967a6b-102f-4ef9-96b9-b1135bd3db86', 'volume_name': 'volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81d848e-9491-49c6-88cc-c710f675a39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81d848e-9491-49c6-88cc-c710f675a39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf83cfb-6cf4-4f85-ae1b-c514eb1ee4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Volume 3e967a6b-102f-4ef9-96b9-b1135bd3db86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86', 'volume_size': 1}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:17 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.info" returned: 0 in 0.466s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:17 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.info is being set with open permissions: ugo+rw
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:17 devstack sudo[86671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.info
Apr 13 18:45:17 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Flow 'volume_create_manager' (4c7f6d5b-80f5-4706-b1f6-db961df5c71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1219ea-e11c-4868-8b7b-9a8fab9cef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e1219ea-e11c-4868-8b7b-9a8fab9cef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2009536266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5da7aa0-5009-4cde-ba9e-6c1e04c33d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e338ed8fab2429192c1f9f30169a88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:17Z,use_quota=True,user_id='cce7c9e5342a416393476e0d059e8e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af11ca9a-2ee7-4930-b31e-9bda3b72e796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af11ca9a-2ee7-4930-b31e-9bda3b72e796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b2791e-6f71-453c-9182-a1886db25471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b2791e-6f71-453c-9182-a1886db25471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5da7aa0-5009-4cde-ba9e-6c1e04c33d45', 'volume_name': 'volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bfc368-acd6-4fe8-84fe-1cbd348c62ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bfc368-acd6-4fe8-84fe-1cbd348c62ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6dbc4f-22c0-4fe7-8d8e-528b07943cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:17 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Volume f5da7aa0-5009-4cde-ba9e-6c1e04c33d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45', 'volume_size': 1}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:17 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.info" returned: 0 in 0.422s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.928s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.660s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:17 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ac292c01-c348-4e58-a27c-ac28eb82a9f8 tempest-VolumesDeleteCascade-232177248 None] Create snapshot completed successfully
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d16a55-d381-4da6-bce9-c92750c8b937]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:17 devstack sudo[86674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b
Apr 13 18:45:17 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:18 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b" returned: 0 in 0.460s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:18 devstack sudo[86678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b
Apr 13 18:45:18 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:18 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b" returned: 1 in 0.477s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.966s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1178782308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e967a6b-102f-4ef9-96b9-b1135bd3db86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06fcf6f2d07477caeef620e3c50b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:17Z,use_quota=True,user_id='759f022891524f8b8559109bd1d7efcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Creating volume 3e967a6b-102f-4ef9-96b9-b1135bd3db86 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:18 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:18 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86 1073741824
Apr 13 18:45:18 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f', 'name': 'volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a167b3d-f483-4d69-b449-4739831b9e0a', 'enforce_multipath': True} {{(pid=82517) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 18:45:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-678f33bc-0475-4e80-ad6b-f68872c493c5 req-427066b8-94f4-4857-983f-85a461da4e7e tempest-ServerBootFromVolumeStableRescueTest-486023479 None] attachment_update completed successfully.
Apr 13 18:45:19 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86 1073741824" returned: 0 in 0.498s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:19 devstack sudo[86688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86
Apr 13 18:45:19 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:19 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86" returned: 0 in 0.464s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.220s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2009536266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5da7aa0-5009-4cde-ba9e-6c1e04c33d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e338ed8fab2429192c1f9f30169a88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:17Z,use_quota=True,user_id='cce7c9e5342a416393476e0d059e8e76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Creating volume f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:19 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf83cfb-6cf4-4f85-ae1b-c514eb1ee4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:19 devstack sudo[86725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 1073741824
Apr 13 18:45:19 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3d037e-1cef-497c-9225-4636f64795dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Volume volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86 (3e967a6b-102f-4ef9-96b9-b1135bd3db86): created successfully
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3d037e-1cef-497c-9225-4636f64795dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Flow 'volume_create_manager' (f53438f0-3f27-4319-af66-0f6b99ed79e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:19 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d96da1f9-39da-44d8-a8aa-c0e26220caac tempest-VolumesTransfersV357Test-95017543 None] Created volume successfully.
Apr 13 18:45:20 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 1073741824" returned: 0 in 0.480s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:20 devstack sudo[86730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45
Apr 13 18:45:20 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:20 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" returned: 0 in 0.452s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.172s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Creating offline snapshot dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 of volume 1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed605e80-8c13-462e-8eb7-a93c4303c810]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6dbc4f-22c0-4fe7-8d8e-528b07943cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa5ff95-f330-418a-8767-266c158091d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:20 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Volume volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 (f5da7aa0-5009-4cde-ba9e-6c1e04c33d45): created successfully
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa5ff95-f330-418a-8767-266c158091d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Flow 'volume_create_manager' (4c7f6d5b-80f5-4706-b1f6-db961df5c71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c3366f2d-0bc0-4739-98b4-b54ddca56358 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Created volume successfully.
Apr 13 18:45:20 devstack sudo[86733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c
Apr 13 18:45:20 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-092ebfa8-678b-4be5-80c7-516468fd5abd tempest-VolumesTransfersV357Test-1324324500 None] Transfer volume completed successfully.
Apr 13 18:45:21 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c" returned: 0 in 0.537s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:21 devstack sudo[86739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 1G
Apr 13 18:45:21 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:21 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 1G" returned: 0 in 0.629s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:21 devstack sudo[86746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46
Apr 13 18:45:21 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Acquiring lock "cinder-3e967a6b-102f-4ef9-96b9-b1135bd3db86-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Lock "cinder-3e967a6b-102f-4ef9-96b9-b1135bd3db86-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Acquiring lock "cinder-quobyte-3e967a6b-102f-4ef9-96b9-b1135bd3db86" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Lock "cinder-quobyte-3e967a6b-102f-4ef9-96b9-b1135bd3db86" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff862611-c412-4d0e-aabc-4e338e88b668]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:21 devstack sudo[86748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86
Apr 13 18:45:22 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:22 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:22 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 is being set with open permissions: ugo+rw
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:22 devstack sudo[86753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46
Apr 13 18:45:22 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:22 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86" returned: 0 in 0.509s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:22 devstack sudo[86758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86
Apr 13 18:45:22 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:22 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46" returned: 0 in 0.448s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.839s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Creating offline snapshot a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 of volume f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:45:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5ba0141f-8878-4593-b19e-8f5104d80024 tempest-VolumesDeleteCascade-232177248 None] Create snapshot completed successfully
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3b55a1-4acc-4123-b875-d9afd90dfaf1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:22 devstack sudo[86761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45
Apr 13 18:45:22 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:22 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3e967a6b-102f-4ef9-96b9-b1135bd3db86" returned: 0 in 0.445s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Lock "cinder-quobyte-3e967a6b-102f-4ef9-96b9-b1135bd3db86" released by "delete_volume" :: held 0.981s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:22 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Created reservations ['27622d8b-0d28-4654-b5f1-a6847e4ecf12', '53a12b29-a962-4d72-b837-c4194090d7c8', '5124b9db-789b-43b7-a0ba-25a567d0ebc2', '3d4cf066-6531-4f81-9590-3a949b5e1c60'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:23 devstack sudo[86764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:23 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:23 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" returned: 0 in 0.771s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:23 devstack sudo[86796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 1G
Apr 13 18:45:23 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-1ab56320-07db-47da-9c2c-c2c4d5ce085c-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-1ab56320-07db-47da-9c2c-c2c4d5ce085c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Performing cascade delete. {{(pid=82517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-8e897259-f068-423a-ade8-37f150e5f34c-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-8e897259-f068-423a-ade8-37f150e5f34c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-1ab56320-07db-47da-9c2c-c2c4d5ce085c" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-1ab56320-07db-47da-9c2c-c2c4d5ce085c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-8e897259-f068-423a-ade8-37f150e5f34c" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-8e897259-f068-423a-ade8-37f150e5f34c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:23 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Deleting offline snapshot 8e897259-f068-423a-ade8-37f150e5f34c of volume 1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] snapshot_file for this snap is: volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.938s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Deleted volume successfully.
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f70fd3-1bf1-41fd-a48b-03fda7e19e94]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b6830a8-c6cd-4087-bf29-623f3e48ca0c tempest-VolumesTransfersV357Test-1401689305 None] Lock "cinder-3e967a6b-102f-4ef9-96b9-b1135bd3db86-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:24 devstack sudo[86799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c
Apr 13 18:45:24 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:24 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 1G" returned: 0 in 0.829s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:24 devstack sudo[86805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2
Apr 13 18:45:24 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Flow 'volume_create_manager' (1070c11f-a198-42fd-bf63-a17f6fa4eb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dcea93-a6b8-4d3a-a2f1-5dbdf7cec7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dcea93-a6b8-4d3a-a2f1-5dbdf7cec7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1989561607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db81c085-6428-4a9d-9b31-25b9c37f962a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06fcf6f2d07477caeef620e3c50b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:24Z,use_quota=True,user_id='759f022891524f8b8559109bd1d7efcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eab3d2f-be12-488a-9742-66c49312d57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eab3d2f-be12-488a-9742-66c49312d57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9718b1d-de42-4876-bc49-936e760eedb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9718b1d-de42-4876-bc49-936e760eedb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db81c085-6428-4a9d-9b31-25b9c37f962a', 'volume_name': 'volume-db81c085-6428-4a9d-9b31-25b9c37f962a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704096cc-fa8d-4dbe-8edf-1f5f3b0a32bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704096cc-fa8d-4dbe-8edf-1f5f3b0a32bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114afc01-6e7e-46f5-8b1e-b042ebfae5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:24 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Volume db81c085-6428-4a9d-9b31-25b9c37f962a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db81c085-6428-4a9d-9b31-25b9c37f962a', 'volume_size': 1}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:24 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c" returned: 0 in 0.826s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7983803-0967-4bd1-8baf-eb479606266d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:24 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2" returned: 0 in 0.501s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:24 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 is being set with open permissions: ugo+rw
Apr 13 18:45:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:24 devstack sudo[86813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c
Apr 13 18:45:24 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:24 devstack sudo[86814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2
Apr 13 18:45:24 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:25 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c" returned: 0 in 0.601s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:25 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2" returned: 0 in 0.552s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:25 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b061861-acb1-4bd8-9ba5-ba611f92272f]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:25 devstack sudo[86822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.info
Apr 13 18:45:25 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:25 devstack sudo[86821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46
Apr 13 18:45:25 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:26 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.info" returned: 0 in 0.606s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:26 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.info is being set with open permissions: ugo+rw
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:26 devstack sudo[86830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.info
Apr 13 18:45:26 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:26 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46" returned: 0 in 0.706s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc67009-790a-46b0-b490-5fbb741c1554]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:26 devstack sudo[86832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c
Apr 13 18:45:26 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:26 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.info" returned: 0 in 0.534s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.907s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.153s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1989561607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db81c085-6428-4a9d-9b31-25b9c37f962a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06fcf6f2d07477caeef620e3c50b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:24Z,use_quota=True,user_id='759f022891524f8b8559109bd1d7efcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Creating volume db81c085-6428-4a9d-9b31-25b9c37f962a {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:26 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:26 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3e6742df-c164-43e0-b939-b657fa6a909f tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Create snapshot completed successfully
Apr 13 18:45:26 devstack sudo[86836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a 1073741824
Apr 13 18:45:26 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:26 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c" returned: 0 in 0.588s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c98eb-47ad-417e-be92-0723e4a8b78e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:26 devstack sudo[86841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c
Apr 13 18:45:26 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:27 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a 1073741824" returned: 0 in 0.526s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:27 devstack sudo[86846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a
Apr 13 18:45:27 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Acquiring lock "cinder-a2486d0e-376e-4bd8-bd77-dd253bf6c5a2-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-a2486d0e-376e-4bd8-bd77-dd253bf6c5a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Acquiring lock "cinder-quobyte-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:27 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c" returned: 0 in 0.591s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-quobyte-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Acquiring lock "cinder-quobyte-a2486d0e-376e-4bd8-bd77-dd253bf6c5a2" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:27 devstack sudo[86851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c
Apr 13 18:45:27 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-quobyte-a2486d0e-376e-4bd8-bd77-dd253bf6c5a2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Deleting offline snapshot a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 of volume f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] snapshot_file for this snap is: volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9192e22-90d0-429b-96da-a783b54cf02e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:27 devstack sudo[86853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2
Apr 13 18:45:27 devstack sudo[86853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:27 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a" returned: 0 in 0.563s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114afc01-6e7e-46f5-8b1e-b042ebfae5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db81c085-6428-4a9d-9b31-25b9c37f962a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046fbe8d-d5e7-4e3b-bb5e-717a3a8a58c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:27 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Volume volume-db81c085-6428-4a9d-9b31-25b9c37f962a (db81c085-6428-4a9d-9b31-25b9c37f962a): created successfully
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046fbe8d-d5e7-4e3b-bb5e-717a3a8a58c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Flow 'volume_create_manager' (1070c11f-a198-42fd-bf63-a17f6fa4eb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:27 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b0b17b49-a3c5-452a-b62a-65c333812a32 tempest-VolumesTransfersV357Test-95017543 None] Created volume successfully.
Apr 13 18:45:28 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c" returned: 0 in 0.640s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:28 devstack sudo[86859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c
Apr 13 18:45:28 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:28 devstack sudo[86853]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2" returned: 0 in 0.838s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aca9d0-452f-42b2-8685-8506e1054648]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:28 devstack sudo[86864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45
Apr 13 18:45:28 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:28 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.8e897259-f068-423a-ade8-37f150e5f34c" returned: 0 in 0.450s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 -F qcow2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:28 devstack sudo[86867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 -F qcow2
Apr 13 18:45:28 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:28 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" returned: 0 in 0.532s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:28 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2
Apr 13 18:45:28 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:28 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 -F qcow2" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Acquiring lock "cinder-db81c085-6428-4a9d-9b31-25b9c37f962a-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-8e897259-f068-423a-ade8-37f150e5f34c" released by "_delete_snapshot" :: held 5.063s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-1ab56320-07db-47da-9c2c-c2c4d5ce085c" released by "delete_snapshot" :: held 5.096s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Lock "cinder-db81c085-6428-4a9d-9b31-25b9c37f962a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Acquiring lock "cinder-quobyte-db81c085-6428-4a9d-9b31-25b9c37f962a" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Created reservations ['97ae9ca3-168c-48be-9126-c10964199e65', 'dc983edd-1408-4e11-af8e-011d5382a7e8', '8a12a69b-cb31-4833-bc8f-32a2a62fa8e2', '6fa8f2b7-f287-4154-bb10-6f5882d92410'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Lock "cinder-quobyte-db81c085-6428-4a9d-9b31-25b9c37f962a" acquired by "delete_volume" :: waited 0.052s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0ca4c4-5aeb-4310-adfc-d5c383a9f530]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:29 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Delete snapshot completed successfully.
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-8e897259-f068-423a-ade8-37f150e5f34c-delete_snapshot" released by "delete_snapshot" :: held 5.369s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:29 devstack sudo[86877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a
Apr 13 18:45:29 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-1ab56320-07db-47da-9c2c-c2c4d5ce085c" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-1ab56320-07db-47da-9c2c-c2c4d5ce085c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Deleting offline snapshot dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 of volume 1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] snapshot_file for this snap is: volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[311442e5-bab1-4cf9-9a8c-8c29b7c3f9ce]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:29 devstack sudo[86879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46
Apr 13 18:45:29 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:29 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2" returned: 0 in 0.671s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:29 devstack sudo[86884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2
Apr 13 18:45:29 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:29 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a" returned: 0 in 0.560s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:29 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a
Apr 13 18:45:29 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:29 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede33b9-a759-4a80-8319-0032eab0da97]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:29 devstack sudo[86894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c
Apr 13 18:45:29 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:29 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45.a2486d0e-376e-4bd8-bd77-dd253bf6c5a2" returned: 0 in 0.431s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-quobyte-a2486d0e-376e-4bd8-bd77-dd253bf6c5a2" released by "_delete_snapshot" :: held 2.530s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-quobyte-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" released by "delete_snapshot" :: held 2.548s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:29 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Created reservations ['c9caf8ee-868b-4659-99bc-b81ce9bd1ebf', '790019db-4381-472d-b4e3-f575c25d355b', '496000d9-5c35-4556-9fe5-b80ecb42e000', '05b4a2a9-beaa-4345-b2aa-bba770b1a9d7'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:29 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Delete snapshot completed successfully.
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a27f5ee3-0544-40d0-b8e5-2e957ec6ed13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-a2486d0e-376e-4bd8-bd77-dd253bf6c5a2-delete_snapshot" released by "delete_snapshot" :: held 2.645s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:30 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-db81c085-6428-4a9d-9b31-25b9c37f962a" returned: 0 in 0.474s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Lock "cinder-quobyte-db81c085-6428-4a9d-9b31-25b9c37f962a" released by "delete_volume" :: held 1.075s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Created reservations ['235a2ce0-0ada-4b60-9936-51e4cb203389', '3b797f3b-4c62-4c24-bc83-8a622df572e1', 'e838b997-3176-40a9-b56b-010fd4c1e25d', '9cbebc78-de55-451f-b37e-d18d63389cc8'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:30 devstack sudo[86905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:30 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:30 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c" returned: 0 in 0.626s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:30 devstack sudo[86926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46
Apr 13 18:45:30 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Acquiring lock "cinder-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Acquiring lock "cinder-quobyte-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-quobyte-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b37e2c2-9f41-4805-bff8-34eeb06d33bf]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:30 devstack sudo[86928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45
Apr 13 18:45:30 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:30 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.561s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:30 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Deleted volume successfully.
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3f82d7cf-30a0-49e1-907e-50fd1610e100 tempest-VolumesTransfersV357Test-1401689305 None] Lock "cinder-db81c085-6428-4a9d-9b31-25b9c37f962a-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:30 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46" returned: 0 in 0.582s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:31 devstack sudo[86935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46
Apr 13 18:45:31 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:31 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" returned: 0 in 0.518s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:31 devstack sudo[86940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45
Apr 13 18:45:31 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:31 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c.dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46" returned: 0 in 0.483s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46" released by "_delete_snapshot" :: held 2.242s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-1ab56320-07db-47da-9c2c-c2c4d5ce085c" released by "delete_snapshot" :: held 2.254s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Created reservations ['67032887-2634-4f94-b17d-ea81502281d3', '3b34b746-da7f-4b97-be23-4b5a478e56d6', '902aaf20-747a-4506-ae32-32ce10f4677b', 'a130e1bb-9072-4598-904e-c9f69288df9d'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:31 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Delete snapshot completed successfully.
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-dc42d031-c9a2-4f2c-9b51-27a1ce8e5d46-delete_snapshot" released by "delete_snapshot" :: held 2.350s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Snapshots deleted, issuing volume delete {{(pid=82517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-1ab56320-07db-47da-9c2c-c2c4d5ce085c" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-1ab56320-07db-47da-9c2c-c2c4d5ce085c" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae26af46-48fa-4780-9957-48d9d766d953]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:31 devstack sudo[86944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c
Apr 13 18:45:31 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:31 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" returned: 0 in 0.613s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-quobyte-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45" released by "delete_volume" :: held 1.161s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Created reservations ['1d35b57b-9de8-4185-9a44-cab7e6b0a089', '465795e3-a080-4023-887d-21fc8cd00baf', '8cd99407-2f28-4150-9f45-20726c1bdee9', '848d5a72-f831-4e84-aefc-b4fde6105c14'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:31 devstack sudo[86949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:31 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:32 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c" returned: 0 in 0.697s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:32 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c
Apr 13 18:45:32 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:32 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.463s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:32 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Deleted volume successfully.
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a67b82e4-925a-4578-8485-45ded6b13f0b tempest-VolumeSnapshotQuotasNegativeTestJSON-2031832810 None] Lock "cinder-f5da7aa0-5009-4cde-ba9e-6c1e04c33d45-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:32 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1ab56320-07db-47da-9c2c-c2c4d5ce085c" returned: 0 in 0.517s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-1ab56320-07db-47da-9c2c-c2c4d5ce085c" released by "delete_volume" :: held 1.242s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Created reservations ['d79bf4b6-324f-4421-ae3e-6b0d210834d0', '48eb96b6-ebbb-451f-af9c-7de7ebff2f5f', 'f1ea9181-7370-481e-887a-2f004424e4c5', 'c1ffecf3-60c1-4859-8de4-67fcc9aaf456'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:32 devstack sudo[86971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:32 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:33 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.489s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:33 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Deleted volume successfully.
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eae85e2d-4793-4c07-a767-dabbf9b9a5bd tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-1ab56320-07db-47da-9c2c-c2c4d5ce085c-delete_volume" released by "delete_volume" :: held 9.636s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Flow 'volume_create_manager' (66123963-1dc7-44cd-bcd4-790ac64e74d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184a6755-9cd1-4d55-8108-8acf06ccd609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184a6755-9cd1-4d55-8108-8acf06ccd609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2120041232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc7e43e-c5db-4c3b-83e7-d493410cd859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e908c20fd540a4bfaf39857defa6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:34Z,use_quota=True,user_id='9101f1e514094d97babec521e2abddf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32311486-894f-40f5-ad82-0713aac0b4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32311486-894f-40f5-ad82-0713aac0b4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f833c618-d0fe-40a2-a6b8-65205ff58dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f833c618-d0fe-40a2-a6b8-65205ff58dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc7e43e-c5db-4c3b-83e7-d493410cd859', 'volume_name': 'volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be71f63-4f14-4175-b3bf-652c7605a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be71f63-4f14-4175-b3bf-652c7605a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb5d536-5b04-4bea-9518-f5d46519711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:33 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Volume 3fc7e43e-c5db-4c3b-83e7-d493410cd859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859', 'volume_size': 1}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2120041232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc7e43e-c5db-4c3b-83e7-d493410cd859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e908c20fd540a4bfaf39857defa6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:34Z,use_quota=True,user_id='9101f1e514094d97babec521e2abddf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Creating volume 3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:33 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:34 devstack sudo[86975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 1073741824
Apr 13 18:45:34 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:34 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 1073741824" returned: 0 in 0.639s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:34 devstack sudo[86980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859
Apr 13 18:45:34 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:35 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859" returned: 0 in 0.593s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb5d536-5b04-4bea-9518-f5d46519711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4ec95c-9580-4679-9c81-ab737bab86e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:35 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Volume volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 (3fc7e43e-c5db-4c3b-83e7-d493410cd859): created successfully
Apr 13 18:45:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4ec95c-9580-4679-9c81-ab737bab86e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Flow 'volume_create_manager' (66123963-1dc7-44cd-bcd4-790ac64e74d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:35 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d636bdfe-80e9-4964-b6d3-597b1cdc535f tempest-VolumesDeleteCascade-232177248 None] Created volume successfully.
Apr 13 18:45:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Creating offline snapshot 01174a90-ff33-4077-b68c-faa14c8a2851 of volume 3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:45:36 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b395743e-b3f3-44f2-a8d4-40595a4a7df5]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:36 devstack sudo[86984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859
Apr 13 18:45:36 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:37 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859" returned: 0 in 0.807s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:37 devstack sudo[87015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 1G
Apr 13 18:45:37 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Flow 'volume_create_manager' (8dc46d91-d727-4151-acd1-d0c7171d5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0e9602-cefc-4d73-ac6c-843329c2214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0e9602-cefc-4d73-ac6c-843329c2214b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-819795692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f498f2a-2ddf-40cf-a33f-9f5b643d3b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5bc65b1d4e4696b5dd98ddc7627ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:37Z,use_quota=True,user_id='918c5e3d16774ae0b97a9517b5ddd8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d86cbf8a-c90a-4ded-a5dd-3272065ef727),volume_type_id=d86cbf8a-c90a-4ded-a5dd-3272065ef727)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ecf1c3-1a99-48f1-b757-2272228c1b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ecf1c3-1a99-48f1-b757-2272228c1b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cce3504-3e99-4559-8565-ca5b3175d463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cce3504-3e99-4559-8565-ca5b3175d463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f498f2a-2ddf-40cf-a33f-9f5b643d3b23', 'volume_name': 'volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96a541c-de0f-4bf0-805e-fbff64ab2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96a541c-de0f-4bf0-805e-fbff64ab2621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f815278-83ab-4907-b25f-738596876ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:37 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Volume 1f498f2a-2ddf-40cf-a33f-9f5b643d3b23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23', 'volume_size': 1}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:37 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 1G" returned: 0 in 0.837s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:37 devstack sudo[87021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851
Apr 13 18:45:37 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:38 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851" returned: 0 in 0.584s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:38 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 is being set with open permissions: ugo+rw
Apr 13 18:45:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:38 devstack sudo[87026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851
Apr 13 18:45:38 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:39 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851" returned: 0 in 0.579s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:39 devstack sudo[87030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.info
Apr 13 18:45:39 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:39 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.info" returned: 0 in 0.604s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:39 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.info is being set with open permissions: ugo+rw
Apr 13 18:45:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:39 devstack sudo[87033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.info
Apr 13 18:45:39 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:40 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.info" returned: 0 in 0.592s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.082s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.791s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-819795692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f498f2a-2ddf-40cf-a33f-9f5b643d3b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5bc65b1d4e4696b5dd98ddc7627ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:37Z,use_quota=True,user_id='918c5e3d16774ae0b97a9517b5ddd8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d86cbf8a-c90a-4ded-a5dd-3272065ef727),volume_type_id=d86cbf8a-c90a-4ded-a5dd-3272065ef727)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Creating volume 1f498f2a-2ddf-40cf-a33f-9f5b643d3b23 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:40 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:40 devstack sudo[87036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23 1073741824
Apr 13 18:45:40 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:40 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f50f5d8b-a1ab-4e4d-b09e-56939c8d90fe tempest-VolumesDeleteCascade-232177248 None] Create snapshot completed successfully
Apr 13 18:45:40 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23 1073741824" returned: 0 in 0.660s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:41 devstack sudo[87042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23
Apr 13 18:45:41 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:41 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23" returned: 0 in 0.554s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f815278-83ab-4907-b25f-738596876ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e01cd1-78cf-4f0a-9f6d-3507b106a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:41 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Volume volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23 (1f498f2a-2ddf-40cf-a33f-9f5b643d3b23): created successfully
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e01cd1-78cf-4f0a-9f6d-3507b106a879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Flow 'volume_create_manager' (8dc46d91-d727-4151-acd1-d0c7171d5e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:41 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-7f955bee-5b6e-47b4-9085-132752412297 tempest-VolumeTypesAccessTest-1648126083 None] Created volume successfully.
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Flow 'volume_create_manager' (dd5bc48b-d5ea-49b4-ad3f-3eed33e7641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3044a94d-e836-4fdb-b66f-d8d6ab311b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3044a94d-e836-4fdb-b66f-d8d6ab311b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1989375962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48fb0539-e203-43e1-aff0-49d12838d501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e908c20fd540a4bfaf39857defa6a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01174a90-ff33-4077-b68c-faa14c8a2851,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:42Z,use_quota=True,user_id='9101f1e514094d97babec521e2abddf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1608c804-3ac2-4cce-92d2-c10f15f43aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1608c804-3ac2-4cce-92d2-c10f15f43aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055c92ff-12b5-4055-aea1-cc5f847226b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (055c92ff-12b5-4055-aea1-cc5f847226b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48fb0539-e203-43e1-aff0-49d12838d501', 'volume_name': 'volume-48fb0539-e203-43e1-aff0-49d12838d501', 'volume_size': 1, 'snapshot_id': '01174a90-ff33-4077-b68c-faa14c8a2851'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79416d98-f03a-46f5-a488-cd00d9f30976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79416d98-f03a-46f5-a488-cd00d9f30976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04713110-a6b7-49db-8631-5f9900f8c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:41 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Volume 48fb0539-e203-43e1-aff0-49d12838d501: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48fb0539-e203-43e1-aff0-49d12838d501', 'volume_size': 1, 'snapshot_id': '01174a90-ff33-4077-b68c-faa14c8a2851'}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Acquiring lock "cinder-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-01174a90-ff33-4077-b68c-faa14c8a2851-48fb0539-e203-43e1-aff0-49d12838d501" by "_create_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Lock "cinder-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-01174a90-ff33-4077-b68c-faa14c8a2851-48fb0539-e203-43e1-aff0-49d12838d501" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Creating volume 48fb0539-e203-43e1-aff0-49d12838d501 from snapshot 01174a90-ff33-4077-b68c-faa14c8a2851 {{(pid=82517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-48fb0539-e203-43e1-aff0-49d12838d501" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-48fb0539-e203-43e1-aff0-49d12838d501" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] snapshot: 01174a90-ff33-4077-b68c-faa14c8a2851, volume: 48fb0539-e203-43e1-aff0-49d12838d501,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Acquiring lock "cinder-quobyte-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ddff50-fbdc-43c0-a9ee-d192cea0bfd7]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Lock "cinder-quobyte-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23" acquired by "delete_volume" :: waited 0.026s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf23308-30a2-4e62-823c-675d11c577cd]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:42 devstack sudo[87070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851
Apr 13 18:45:42 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:42 devstack sudo[87071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23
Apr 13 18:45:42 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Flow 'volume_create_manager' (a1691523-31cc-4df1-9651-2c998ff5e4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab07002-b3ae-447e-8492-2f774cfc6280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab07002-b3ae-447e-8492-2f774cfc6280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-303040823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64de204-04b7-4a82-b5f0-f8043ca72a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c54a54a899465cb8741b84cf7c4e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:42Z,use_quota=True,user_id='8f779735448e4bf08bb6ebfa26ea436c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda5200d-30a7-45bb-92d2-60c570054a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda5200d-30a7-45bb-92d2-60c570054a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708342f5-ace0-4c04-8389-be72cd064e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708342f5-ace0-4c04-8389-be72cd064e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64de204-04b7-4a82-b5f0-f8043ca72a18', 'volume_name': 'volume-d64de204-04b7-4a82-b5f0-f8043ca72a18', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ea8975-3735-4089-a491-4dfb6a400ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ea8975-3735-4089-a491-4dfb6a400ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906e0f42-478a-4d4f-a97b-963c2cfbd7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:42 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Volume d64de204-04b7-4a82-b5f0-f8043ca72a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64de204-04b7-4a82-b5f0-f8043ca72a18', 'volume_size': 1}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:42 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23" returned: 0 in 0.747s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:42 devstack sudo[87100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23
Apr 13 18:45:42 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:42 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851" returned: 0 in 0.853s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4cf2c4-cbaf-4f4d-bebb-6f32694f7ecb]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:43 devstack sudo[87102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859
Apr 13 18:45:43 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:43 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23" returned: 0 in 0.664s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Lock "cinder-quobyte-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23" released by "delete_volume" :: held 1.448s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:43 devstack cinder-volume[82517]: WARNING cinder.quota [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-775583570 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-775583570, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:45:43 devstack cinder-volume[82517]: WARNING cinder.quota [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-775583570 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-775583570, it is now deprecated. Please use the default quota class for default quota.
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Created reservations ['74b032a3-b0c5-480d-99b9-5f154c47983a', 'c0c84e6a-7b2f-4ea1-8710-85cd8d7648e8', 'b5cd5b33-97de-4589-bb61-63460d832fd5', 'bb10da16-be60-4ebf-9df8-e4261530431c'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:43 devstack sudo[87109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:43 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:43 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859" returned: 0 in 0.763s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501 not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:45:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:43 devstack sudo[87111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501
Apr 13 18:45:43 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:44 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.611s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:44 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:44 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Deleted volume successfully.
Apr 13 18:45:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-80a9e4aa-1cc2-4e50-a4b5-c6dcf64bc0ab tempest-VolumeTypesAccessTest-1648126083 None] Lock "cinder-1f498f2a-2ddf-40cf-a33f-9f5b643d3b23-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:46 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501" returned: 0 in 2.961s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:46 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de68159-c550-4efc-a94b-f3e9fbc7d738]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:46 devstack sudo[87146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859
Apr 13 18:45:46 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:47 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859" returned: 0 in 0.713s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859, size 1024.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501 {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:45:47 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Converted 1024.00 MB image at 345.70 MB/s
Apr 13 18:45:47 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501 is being set with open permissions: ugo+rw
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:47 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501
Apr 13 18:45:47 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:47 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-2f2bb97d-c9d5-448b-8864-e22c207376b2 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Terminate volume connection completed successfully.
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-2f2bb97d-c9d5-448b-8864-e22c207376b2 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Deleting attachment 1a167b3d-f483-4d69-b449-4739831b9e0a. {{(pid=82517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 18:45:47 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501" returned: 0 in 0.488s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-48fb0539-e203-43e1-aff0-49d12838d501" released by "_copy_volume_from_snapshot" :: held 5.845s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-01174a90-ff33-4077-b68c-faa14c8a2851-48fb0539-e203-43e1-aff0-49d12838d501" released by "_create_volume_from_snapshot" :: held 5.863s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.883s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.302s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-303040823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64de204-04b7-4a82-b5f0-f8043ca72a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c54a54a899465cb8741b84cf7c4e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:42Z,use_quota=True,user_id='8f779735448e4bf08bb6ebfa26ea436c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Creating volume d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:47 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:47 devstack sudo[87157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 1073741824
Apr 13 18:45:47 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04713110-a6b7-49db-8631-5f9900f8c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48fb0539-e203-43e1-aff0-49d12838d501', 'volume_size': 1, 'snapshot_id': '01174a90-ff33-4077-b68c-faa14c8a2851'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f359bf8-531c-4882-9713-160178397c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:47 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Volume volume-48fb0539-e203-43e1-aff0-49d12838d501 (48fb0539-e203-43e1-aff0-49d12838d501): created successfully
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f359bf8-531c-4882-9713-160178397c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:47 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Flow 'volume_create_manager' (dd5bc48b-d5ea-49b4-ad3f-3eed33e7641e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:47 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b4ccc70f-88c7-4c31-ab3f-838ae50c8852 tempest-VolumesDeleteCascade-232177248 None] Created volume successfully.
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-3fc7e43e-c5db-4c3b-83e7-d493410cd859-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-3fc7e43e-c5db-4c3b-83e7-d493410cd859-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Performing cascade delete. {{(pid=82517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-01174a90-ff33-4077-b68c-faa14c8a2851-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-01174a90-ff33-4077-b68c-faa14c8a2851-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-3fc7e43e-c5db-4c3b-83e7-d493410cd859" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "cinder-ebd7c91c-b3b0-4fed-891b-15663e8e476b-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:48 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "cinder-ebd7c91c-b3b0-4fed-891b-15663e8e476b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-3fc7e43e-c5db-4c3b-83e7-d493410cd859" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-01174a90-ff33-4077-b68c-faa14c8a2851" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 1073741824" returned: 0 in 0.640s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-01174a90-ff33-4077-b68c-faa14c8a2851" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Deleting offline snapshot 01174a90-ff33-4077-b68c-faa14c8a2851 of volume 3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] snapshot_file for this snap is: volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "cinder-quobyte-ebd7c91c-b3b0-4fed-891b-15663e8e476b" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704e919-530a-4f4d-b9e7-4c858a944455]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "cinder-quobyte-ebd7c91c-b3b0-4fed-891b-15663e8e476b" acquired by "delete_volume" :: waited 0.032s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:48 devstack sudo[87163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18
Apr 13 18:45:48 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f9e35b-24b8-4dd5-84a3-46d4d0b6af45]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:48 devstack sudo[87162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851
Apr 13 18:45:48 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:48 devstack sudo[87165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b
Apr 13 18:45:48 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:49 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18" returned: 0 in 0.533s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906e0f42-478a-4d4f-a97b-963c2cfbd7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64de204-04b7-4a82-b5f0-f8043ca72a18', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09bcdd9-8764-42a4-8e87-9c2a9941c2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:49 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Volume volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 (d64de204-04b7-4a82-b5f0-f8043ca72a18): created successfully
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09bcdd9-8764-42a4-8e87-9c2a9941c2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Flow 'volume_create_manager' (a1691523-31cc-4df1-9651-2c998ff5e4e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a3947ee4-4992-44e6-9145-fcf7d6905ff3 tempest-VolumesActionsTest-449282182 None] Created volume successfully.
Apr 13 18:45:49 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851" returned: 0 in 0.633s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[074e7884-fce9-4635-b49f-ea51d3429dd2]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:49 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b" returned: 0 in 0.656s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:49 devstack sudo[87174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859
Apr 13 18:45:49 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:49 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b
Apr 13 18:45:49 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:49 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859" returned: 0 in 0.548s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:49 devstack sudo[87184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851
Apr 13 18:45:49 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:49 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b" returned: 1 in 0.504s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:45:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:49 devstack sudo[87186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b
Apr 13 18:45:49 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Flow 'volume_create_manager' (deb1cd47-156f-44b5-a438-cf24f09ddef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9171bbe-1d82-4d6d-a7ec-4d6b1a4bb926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:50 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ebd7c91c-b3b0-4fed-891b-15663e8e476b" returned: 0 in 0.508s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9171bbe-1d82-4d6d-a7ec-4d6b1a4bb926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1419323358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6883ecbb-5972-45d0-b068-8e0bbd3efdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850c908aa9084d3b9987a85e224f2613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:50Z,use_quota=True,user_id='12e1481fd3e64c47949d98b3e7d2e625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50502439-07b9-40d8-bffc-b7fa8c8ec559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50502439-07b9-40d8-bffc-b7fa8c8ec559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f20059f-f157-41d4-9e0a-ecbacb998331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f20059f-f157-41d4-9e0a-ecbacb998331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6883ecbb-5972-45d0-b068-8e0bbd3efdbf', 'volume_name': 'volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92aa0d4-2241-4c46-99ad-726f7685e882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92aa0d4-2241-4c46-99ad-726f7685e882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf091c4e-67ad-4b64-b200-1b4f3fc1df8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:50 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Volume 6883ecbb-5972-45d0-b068-8e0bbd3efdbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf', 'volume_size': 1}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1419323358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6883ecbb-5972-45d0-b068-8e0bbd3efdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850c908aa9084d3b9987a85e224f2613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:50Z,use_quota=True,user_id='12e1481fd3e64c47949d98b3e7d2e625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Creating volume 6883ecbb-5972-45d0-b068-8e0bbd3efdbf {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:50 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:50 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "cinder-quobyte-ebd7c91c-b3b0-4fed-891b-15663e8e476b" released by "delete_volume" :: held 1.797s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851" returned: 0 in 0.633s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:50 devstack sudo[87192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf 1073741824
Apr 13 18:45:50 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:50 devstack sudo[87194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851
Apr 13 18:45:50 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.quota [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Created reservations ['7ae18106-57f0-41f2-9955-4bb202ef8a96', '9312e890-903e-4fe2-9d97-67ce1a1c2f98', 'fc69aa0a-8fd4-40a4-851a-58f91a50e8e2', '40bcbdb4-9e28-443a-99d4-721fcb2c7dbc'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:50 devstack sudo[87196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:50 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:50 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859.01174a90-ff33-4077-b68c-faa14c8a2851" returned: 0 in 0.523s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-01174a90-ff33-4077-b68c-faa14c8a2851" released by "_delete_snapshot" :: held 2.404s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-3fc7e43e-c5db-4c3b-83e7-d493410cd859" released by "delete_snapshot" :: held 2.456s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:51 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf 1073741824" returned: 0 in 0.600s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Created reservations ['41daa706-73cd-46a6-ac9a-daced41cafe6', '5532190b-2db5-4f88-b54a-c0f214dec9f8', 'f81a38b1-8a41-4414-85fd-904433b6f497', '312db7d9-353e-49ad-a6f5-07f65d8d9bd6'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:51 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf
Apr 13 18:45:51 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:51 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Delete snapshot completed successfully.
Apr 13 18:45:51 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-01174a90-ff33-4077-b68c-faa14c8a2851-delete_snapshot" released by "delete_snapshot" :: held 2.615s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Snapshots deleted, issuing volume delete {{(pid=82517) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-3fc7e43e-c5db-4c3b-83e7-d493410cd859" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.558s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.manager [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:51 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Deleted volume successfully.
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-3fc7e43e-c5db-4c3b-83e7-d493410cd859" acquired by "delete_volume" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c74054-fa7e-4b06-a3dd-079208c7d53d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f25b0b68-70e0-4de6-90d4-437e7d7c8d3f req-516c1d5b-dcff-4569-ac88-57b7876d11a0 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "cinder-ebd7c91c-b3b0-4fed-891b-15663e8e476b-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:51 devstack sudo[87208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859
Apr 13 18:45:51 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:51 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf" returned: 0 in 0.515s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf091c4e-67ad-4b64-b200-1b4f3fc1df8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76db9b0-a411-4c30-bc5b-a6f44485c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:51 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Volume volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf (6883ecbb-5972-45d0-b068-8e0bbd3efdbf): created successfully
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76db9b0-a411-4c30-bc5b-a6f44485c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Flow 'volume_create_manager' (deb1cd47-156f-44b5-a438-cf24f09ddef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:51 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3d5d087e-f3ce-453f-b8df-f6b18194b520 tempest-VolumesListAdminTestJSON-1812115056 None] Created volume successfully.
Apr 13 18:45:51 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859" returned: 0 in 0.604s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:51 devstack sudo[87216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859
Apr 13 18:45:51 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:52 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3fc7e43e-c5db-4c3b-83e7-d493410cd859" returned: 0 in 0.436s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-3fc7e43e-c5db-4c3b-83e7-d493410cd859" released by "delete_volume" :: held 1.069s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Created reservations ['af5c3999-155d-4ee7-962a-025d74e63c97', 'b0df29dc-143e-45e3-9ced-05f3faf5dc9a', 'b091c2c1-a64f-412b-9ac6-c8c0b4c0fd4a', 'd54af25f-3e92-41c1-9bbc-663b238512ea'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:52 devstack sudo[87219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:52 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:52 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.442s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Flow 'volume_create_manager' (0e726967-460e-4518-8b81-f7f9567224b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9dc49f8-6bab-42bb-87c6-c1a1dcca149b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:52 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Deleted volume successfully.
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-53e595a3-2a34-46a0-8010-9252817f3b10 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-3fc7e43e-c5db-4c3b-83e7-d493410cd859-delete_volume" released by "delete_volume" :: held 4.369s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9dc49f8-6bab-42bb-87c6-c1a1dcca149b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1544556147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7403e900-00b6-4bee-9b90-88aabac7d277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850c908aa9084d3b9987a85e224f2613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:53Z,use_quota=True,user_id='12e1481fd3e64c47949d98b3e7d2e625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ade703c-54f0-4ab3-adde-69c6518e90a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ade703c-54f0-4ab3-adde-69c6518e90a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea1f51b-3f20-4c6c-a071-020cf60e63ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea1f51b-3f20-4c6c-a071-020cf60e63ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7403e900-00b6-4bee-9b90-88aabac7d277', 'volume_name': 'volume-7403e900-00b6-4bee-9b90-88aabac7d277', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61403a1f-813d-47ab-8795-b55413b692e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61403a1f-813d-47ab-8795-b55413b692e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a253d0-5cab-4b1b-8c90-5286d55f4bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:52 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Volume 7403e900-00b6-4bee-9b90-88aabac7d277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7403e900-00b6-4bee-9b90-88aabac7d277', 'volume_size': 1}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1544556147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7403e900-00b6-4bee-9b90-88aabac7d277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850c908aa9084d3b9987a85e224f2613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:53Z,use_quota=True,user_id='12e1481fd3e64c47949d98b3e7d2e625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Creating volume 7403e900-00b6-4bee-9b90-88aabac7d277 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:52 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:52 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277 1073741824
Apr 13 18:45:52 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-48fb0539-e203-43e1-aff0-49d12838d501-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-48fb0539-e203-43e1-aff0-49d12838d501-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "cinder-quobyte-48fb0539-e203-43e1-aff0-49d12838d501" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-48fb0539-e203-43e1-aff0-49d12838d501" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a3b8a2-baf9-4ae8-b378-01cb879ecec4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:53 devstack sudo[87247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501
Apr 13 18:45:53 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:53 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277 1073741824" returned: 0 in 0.666s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:53 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277
Apr 13 18:45:53 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:53 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501" returned: 0 in 0.597s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:53 devstack sudo[87259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501
Apr 13 18:45:53 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:53 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277" returned: 0 in 0.409s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a253d0-5cab-4b1b-8c90-5286d55f4bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7403e900-00b6-4bee-9b90-88aabac7d277', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1633f54-81a2-4dfd-837b-0780636cb639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:53 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Volume volume-7403e900-00b6-4bee-9b90-88aabac7d277 (7403e900-00b6-4bee-9b90-88aabac7d277): created successfully
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1633f54-81a2-4dfd-837b-0780636cb639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Flow 'volume_create_manager' (0e726967-460e-4518-8b81-f7f9567224b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4eda6a81-dc62-42d3-8454-2cde8f8df18f tempest-VolumesListAdminTestJSON-1812115056 None] Created volume successfully.
Apr 13 18:45:54 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-48fb0539-e203-43e1-aff0-49d12838d501" returned: 0 in 0.416s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-quobyte-48fb0539-e203-43e1-aff0-49d12838d501" released by "delete_volume" :: held 1.041s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Created reservations ['15114087-558e-47a8-8cbb-f4bb9a65cfcb', '38c2d7cc-6f24-4832-80fa-b968934f05c1', '5d4bf1c7-f852-46eb-b130-14596d8392a6', '8a600f7e-2dc7-4d70-b753-6cdb2aba07e1'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:54 devstack sudo[87264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:45:54 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:54 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.464s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:45:54 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Deleted volume successfully.
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b45ecb1-6cc7-4cc5-bd02-47338e584407 tempest-VolumesDeleteCascade-232177248 None] Lock "cinder-48fb0539-e203-43e1-aff0-49d12838d501-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:45:54 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=166,cinder:UPDATE=188,cinder:INSERT=45,cinder:DELETE=15 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:UPDATE=178,cinder:DELETE=18,cinder:SELECT=136,cinder:INSERT=57 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Flow 'volume_create_manager' (2524cf3a-f4a8-445f-8392-0cffec4752c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766cd3ab-a126-429f-842a-3be35b1f889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766cd3ab-a126-429f-842a-3be35b1f889e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-697589796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f7f157-ec1a-4bcc-a173-0ec0a60306ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850c908aa9084d3b9987a85e224f2613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:55Z,use_quota=True,user_id='12e1481fd3e64c47949d98b3e7d2e625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4864f722-6709-45c3-a11c-7f861453608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4864f722-6709-45c3-a11c-7f861453608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c402cf9-8e05-41db-a813-7a67fdfb8567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c402cf9-8e05-41db-a813-7a67fdfb8567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f7f157-ec1a-4bcc-a173-0ec0a60306ac', 'volume_name': 'volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c177c91b-b4e4-43d4-8be8-610771230c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c177c91b-b4e4-43d4-8be8-610771230c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb1328c-f78d-44d5-b0d8-70617c21fed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:55 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Volume e3f7f157-ec1a-4bcc-a173-0ec0a60306ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac', 'volume_size': 1}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-697589796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f7f157-ec1a-4bcc-a173-0ec0a60306ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850c908aa9084d3b9987a85e224f2613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:55Z,use_quota=True,user_id='12e1481fd3e64c47949d98b3e7d2e625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Creating volume e3f7f157-ec1a-4bcc-a173-0ec0a60306ac {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:55 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:55 devstack sudo[87268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac 1073741824
Apr 13 18:45:55 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:55 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac 1073741824" returned: 0 in 0.600s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:55 devstack sudo[87273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac
Apr 13 18:45:55 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:56 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac" returned: 0 in 0.537s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb1328c-f78d-44d5-b0d8-70617c21fed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d3f1bc-2f28-4cee-a43e-e628123967ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:56 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Volume volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac (e3f7f157-ec1a-4bcc-a173-0ec0a60306ac): created successfully
Apr 13 18:45:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d3f1bc-2f28-4cee-a43e-e628123967ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Flow 'volume_create_manager' (2524cf3a-f4a8-445f-8392-0cffec4752c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-1c126038-3b35-4a63-9a93-b2c671fd77da tempest-VolumesListAdminTestJSON-1812115056 None] Created volume successfully.
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Flow 'volume_create_manager' (5d193972-b525-4497-bd91-a2c4241fe896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b83b912-33d6-4c22-8b13-95e274798f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b83b912-33d6-4c22-8b13-95e274798f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-990379958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40979783-ecb7-4740-af1c-98440df2bab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa033b6946444f993366f3d6bd54ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:57Z,use_quota=True,user_id='505f60ed2cb2421c990b1bf52644a1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272d80cc-285b-47ff-a29a-f6afe14e6dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272d80cc-285b-47ff-a29a-f6afe14e6dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72454b19-21a6-4b94-aaf0-33fe3c14a3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72454b19-21a6-4b94-aaf0-33fe3c14a3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40979783-ecb7-4740-af1c-98440df2bab0', 'volume_name': 'volume-40979783-ecb7-4740-af1c-98440df2bab0', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c613e7cb-7cfd-41e8-be65-ae454758d674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c613e7cb-7cfd-41e8-be65-ae454758d674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b392f5b-13be-4e7a-ac76-8d80be957776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Volume 40979783-ecb7-4740-af1c-98440df2bab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40979783-ecb7-4740-af1c-98440df2bab0', 'volume_size': 1}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-990379958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40979783-ecb7-4740-af1c-98440df2bab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa033b6946444f993366f3d6bd54ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:57Z,use_quota=True,user_id='505f60ed2cb2421c990b1bf52644a1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Creating volume 40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:57 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:57 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 1073741824
Apr 13 18:45:57 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Flow 'volume_create_manager' (0a250ba6-3bc1-4800-b27b-3729795905f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef5e48d-540f-4d48-af4c-4a92d86c10f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef5e48d-540f-4d48-af4c-4a92d86c10f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18708ee42489438686a94979ccc09f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:57Z,use_quota=True,user_id='5b628257d1df4663b023085dc79b98bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a6ec67-5db4-488c-befa-fb00359513cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a6ec67-5db4-488c-befa-fb00359513cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f1814d-d4f2-4e44-8a5e-08442b0af60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f1814d-d4f2-4e44-8a5e-08442b0af60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a', 'volume_name': 'volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a67a4ff-afe8-47c5-befd-599538cd4b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a67a4ff-afe8-47c5-befd-599538cd4b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1d5f8c-db70-4377-ac24-e8f7cbecce8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:57 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Volume 3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a', 'volume_size': 1}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:57 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 1073741824" returned: 0 in 0.561s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:57 devstack sudo[87297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0
Apr 13 18:45:57 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:58 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0" returned: 0 in 0.485s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18708ee42489438686a94979ccc09f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:45:57Z,use_quota=True,user_id='5b628257d1df4663b023085dc79b98bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Creating volume 3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:45:58 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b392f5b-13be-4e7a-ac76-8d80be957776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40979783-ecb7-4740-af1c-98440df2bab0', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d590903e-5118-41fa-aa6a-586e751ca39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:58 devstack sudo[87301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a 1073741824
Apr 13 18:45:58 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:58 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Volume volume-40979783-ecb7-4740-af1c-98440df2bab0 (40979783-ecb7-4740-af1c-98440df2bab0): created successfully
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d590903e-5118-41fa-aa6a-586e751ca39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Flow 'volume_create_manager' (5d193972-b525-4497-bd91-a2c4241fe896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:58 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-45fd2c52-e54f-453b-9f35-e4e197009fb5 tempest-VolumesCloneTest-1386898110 None] Created volume successfully.
Apr 13 18:45:58 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a 1073741824" returned: 0 in 0.502s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:58 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a
Apr 13 18:45:58 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:59 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a" returned: 0 in 0.524s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1d5f8c-db70-4377-ac24-e8f7cbecce8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69e54e9-c78c-415d-9d5a-780d4357d433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:59 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Volume volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a (3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a): created successfully
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69e54e9-c78c-415d-9d5a-780d4357d433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Flow 'volume_create_manager' (0a250ba6-3bc1-4800-b27b-3729795905f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:59 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d6f137dc-6a1d-44da-b193-4bf49ef725c3 tempest-VolumesListAdminTestJSON-1534373316 None] Created volume successfully.
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Acquiring lock "cinder-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Lock "cinder-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Acquiring lock "cinder-quobyte-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Lock "cinder-quobyte-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a" acquired by "delete_volume" :: waited 0.029s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "cinder-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[621788cb-9efa-443e-8802-bd74d362e56c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Flow 'volume_create_manager' (90e3e7b9-9fd6-4bd7-b176-6d760457a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff11da9e-d64d-44fc-ab79-abd2db0e3349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff11da9e-d64d-44fc-ab79-abd2db0e3349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-836430468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd777a40-d85c-4211-81b3-8504ce1a38a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa033b6946444f993366f3d6bd54ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=40979783-ecb7-4740-af1c-98440df2bab0,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:00Z,use_quota=True,user_id='505f60ed2cb2421c990b1bf52644a1e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c04fc52-695f-4494-9038-7b09bf81b483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c04fc52-695f-4494-9038-7b09bf81b483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ae170e-fe08-4131-a3a1-6c2212256e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ae170e-fe08-4131-a3a1-6c2212256e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd777a40-d85c-4211-81b3-8504ce1a38a0', 'volume_name': 'volume-cd777a40-d85c-4211-81b3-8504ce1a38a0', 'volume_size': 2, 'source_volid': '40979783-ecb7-4740-af1c-98440df2bab0', 'source_volstatus': 'available'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f38ce0-7edd-48e3-a884-7f56c61992d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:59 devstack sudo[87332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a
Apr 13 18:45:59 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f38ce0-7edd-48e3-a884-7f56c61992d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6075b0c-6332-44fb-ac40-db5558da2059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:45:59 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Volume cd777a40-d85c-4211-81b3-8504ce1a38a0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd777a40-d85c-4211-81b3-8504ce1a38a0', 'volume_size': 2, 'source_volid': '40979783-ecb7-4740-af1c-98440df2bab0', 'source_volstatus': 'available'}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:45:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:45:59 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Cloning volume 40979783-ecb7-4740-af1c-98440df2bab0 to volume cd777a40-d85c-4211-81b3-8504ce1a38a0
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Creating offline snapshot 70d48128-b141-4744-8d96-fab7186df5c0 of volume 40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[92023f31-3c69-499d-975d-889a38ade183]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "cinder-quobyte-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-quobyte-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac" acquired by "delete_volume" :: waited 0.020s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7735aa-46ce-44a6-bcba-0d3b76034d37]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:00 devstack sudo[87335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0
Apr 13 18:46:00 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:00 devstack sudo[87336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac
Apr 13 18:46:00 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:00 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a" returned: 0 in 0.540s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:00 devstack sudo[87344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a
Apr 13 18:46:00 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:00 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0" returned: 0 in 0.558s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:00 devstack sudo[87353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 1G
Apr 13 18:46:00 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:00 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac" returned: 0 in 0.562s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:00 devstack sudo[87355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac
Apr 13 18:46:00 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_service.periodic_task [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:00 devstack sudo[87359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:00 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:00 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a" returned: 0 in 0.574s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Lock "cinder-quobyte-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a" released by "delete_volume" :: held 1.144s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Created reservations ['623df2b4-5b56-46c4-a966-494ea4b54ddc', '82ddb572-1f5c-4153-be3f-1c05facdc208', '04d7dd3d-f571-4396-b1d7-ed6ca09fda5d', '05332a53-1fc6-45c6-93a8-af2618a1ce25'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:01 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:01 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:01 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac" returned: 0 in 0.548s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-quobyte-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac" released by "delete_volume" :: held 1.134s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Created reservations ['d06ed81c-4dbe-4bda-bfbb-c52024f8198f', '04073793-cf81-44b9-bb45-3f64ad47528b', 'a71940f8-bcd2-45a6-a8ea-a24ee7eece2f', 'fb60528f-deb8-4c53-b025-8fb4fa8b4a79'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:01 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 1G" returned: 0 in 0.661s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40979783-ecb7-4740-af1c-98440df2bab0 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:01 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40979783-ecb7-4740-af1c-98440df2bab0 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0
Apr 13 18:46:01 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:01 devstack sudo[87368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:01 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:01 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.552s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:01 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.532s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:01 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Deleted volume successfully.
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f6c3b27c-c463-4ca8-8e72-c892435d9b9e tempest-VolumesListAdminTestJSON-1534373316 None] Lock "cinder-3b9e5630-2bc3-4c3a-877d-cd83dcb5ba4a-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:01 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.522s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:01 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Deleted volume successfully.
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa112ece-1118-42c4-a186-d9c9a8023b05 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-e3f7f157-ec1a-4bcc-a173-0ec0a60306ac-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:01 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-e2244e6e-4d3e-4ee9-9d9f-d5433a6ef2aa tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Terminate volume connection completed successfully.
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-e2244e6e-4d3e-4ee9-9d9f-d5433a6ef2aa tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Deleting attachment db3a73fc-c583-4973-9214-8e06973aa827. {{(pid=82517) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 18:46:01 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40979783-ecb7-4740-af1c-98440df2bab0 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0" returned: 0 in 0.682s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:01 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 is being set with open permissions: ugo+rw
Apr 13 18:46:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:02 devstack sudo[87401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0
Apr 13 18:46:02 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "cinder-7403e900-00b6-4bee-9b90-88aabac7d277-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-7403e900-00b6-4bee-9b90-88aabac7d277-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "cinder-quobyte-7403e900-00b6-4bee-9b90-88aabac7d277" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-quobyte-7403e900-00b6-4bee-9b90-88aabac7d277" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4e6c42-5086-4357-8003-45878d181ed6]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:02 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277
Apr 13 18:46:02 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "cinder-5721f913-3de2-449a-bf6e-ad64129aef08-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "cinder-5721f913-3de2-449a-bf6e-ad64129aef08-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "cinder-quobyte-5721f913-3de2-449a-bf6e-ad64129aef08" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "cinder-quobyte-5721f913-3de2-449a-bf6e-ad64129aef08" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2308461-7b57-4a57-9f78-e779769bac6e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:02 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0" returned: 0 in 0.644s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:02 devstack sudo[87408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.info
Apr 13 18:46:02 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:02 devstack sudo[87407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08
Apr 13 18:46:02 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:02 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277" returned: 0 in 0.588s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:02 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277
Apr 13 18:46:02 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:03 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.info" returned: 0 in 0.448s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:03 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.info is being set with open permissions: ugo+rw
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:03 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:03 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.info
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08" returned: 0 in 0.521s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:03 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:03 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08
Apr 13 18:46:03 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:03 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7403e900-00b6-4bee-9b90-88aabac7d277" returned: 0 in 0.474s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-quobyte-7403e900-00b6-4bee-9b90-88aabac7d277" released by "delete_volume" :: held 1.097s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Created reservations ['911786c2-8adc-4fd7-9cbf-ab7d2a1ab622', 'f2a365b6-7921-4909-a8fb-195636aab067', 'e8605e20-1cd0-401d-b14f-d1a1a69c200a', 'd00cda8b-608c-4018-b97b-9abb2d6fec91'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:03 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:03 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:03 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.info" returned: 0 in 0.484s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Acquiring lock "cinder-quobyte-cd777a40-d85c-4211-81b3-8504ce1a38a0" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Lock "cinder-quobyte-cd777a40-d85c-4211-81b3-8504ce1a38a0" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] snapshot: 70d48128-b141-4744-8d96-fab7186df5c0, volume: cd777a40-d85c-4211-81b3-8504ce1a38a0,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:46:03 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5721f913-3de2-449a-bf6e-ad64129aef08" returned: 0 in 0.537s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d3c990-ca59-4580-b5e5-3d52a376ad88]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "cinder-quobyte-5721f913-3de2-449a-bf6e-ad64129aef08" released by "delete_volume" :: held 1.099s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.quota [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Created reservations ['b224845f-ab14-4c83-b278-6d3a9e8e4dd8', '12d75194-87ef-4eaf-b367-859702369470', '495593d7-3de5-49ab-864c-1baa544dd233', '0252440b-877a-4010-bda2-634a10492670'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:03 devstack sudo[87431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0
Apr 13 18:46:03 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:03 devstack sudo[87433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:03 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:03 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.573s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:03 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:03 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Deleted volume successfully.
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a3724ad2-3c2a-4e8e-9b5c-2c6144f11107 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-7403e900-00b6-4bee-9b90-88aabac7d277-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:04 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0" returned: 0 in 0.605s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40979783-ecb7-4740-af1c-98440df2bab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[828e9d00-54eb-4726-add0-acaaf9c67dfb]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:04 devstack sudo[87439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0
Apr 13 18:46:04 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:04 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.634s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.manager [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:04 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Deleted volume successfully.
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-b8679de4-d1d0-4db3-b42e-a97c2f7f185c req-9aa7d144-cb5f-44b8-a28e-7f51b1e8f1c3 tempest-ServerBootFromVolumeStableRescueTest-486023479 None] Lock "cinder-5721f913-3de2-449a-bf6e-ad64129aef08-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "cinder-6883ecbb-5972-45d0-b068-8e0bbd3efdbf-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-6883ecbb-5972-45d0-b068-8e0bbd3efdbf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "cinder-quobyte-6883ecbb-5972-45d0-b068-8e0bbd3efdbf" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-quobyte-6883ecbb-5972-45d0-b068-8e0bbd3efdbf" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9904e22-c551-4ed0-8396-0d1c69ca0f41]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:04 devstack sudo[87442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf
Apr 13 18:46:04 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:04 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0" returned: 0 in 0.618s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0 not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:46:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:04 devstack sudo[87447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0
Apr 13 18:46:04 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:05 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d97d883-a137-44f1-94f6-6ae8c9b71453 tempest-VolumesActionsTest-449282182 None] Acquiring lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18" by "attach_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf" returned: 0 in 0.518s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:05 devstack sudo[87452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf
Apr 13 18:46:05 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d97d883-a137-44f1-94f6-6ae8c9b71453 tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18" acquired by "attach_volume" :: waited 0.040s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3d97d883-a137-44f1-94f6-6ae8c9b71453 tempest-VolumesActionsTest-449282182 None] Attaching volume d64de204-04b7-4a82-b5f0-f8043ca72a18 to instance 8f99ce8d-1262-442a-82f8-27346e864356 at mountpoint /dev/vdb on host None.
Apr 13 18:46:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3d97d883-a137-44f1-94f6-6ae8c9b71453 tempest-VolumesActionsTest-449282182 None] Attach volume completed successfully.
Apr 13 18:46:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d97d883-a137-44f1-94f6-6ae8c9b71453 tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18" released by "attach_volume" :: held 0.105s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:05 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6883ecbb-5972-45d0-b068-8e0bbd3efdbf" returned: 0 in 0.501s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-quobyte-6883ecbb-5972-45d0-b068-8e0bbd3efdbf" released by "delete_volume" :: held 1.090s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-984ac9d1-6967-46c8-ac62-cb6a693bff68 tempest-VolumesActionsTest-449282182 None] Acquiring lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18-detach_volume" by "detach_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:05 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Created reservations ['8ba0c27f-a6ae-4257-baea-66140b1dc3bd', '2e0370cb-9e98-4896-9402-b03652e4d4d2', '49fb704e-ec71-48ed-ad11-7154e999c538', 'f72fc8b9-6368-405c-b167-c352049360a9'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-984ac9d1-6967-46c8-ac62-cb6a693bff68 tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18-detach_volume" acquired by "detach_volume" :: waited 0.095s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:06 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-984ac9d1-6967-46c8-ac62-cb6a693bff68 tempest-VolumesActionsTest-449282182 None] Detaching volume d64de204-04b7-4a82-b5f0-f8043ca72a18 from instance 8f99ce8d-1262-442a-82f8-27346e864356.
Apr 13 18:46:06 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-984ac9d1-6967-46c8-ac62-cb6a693bff68 tempest-VolumesActionsTest-449282182 None] Detach volume completed successfully.
Apr 13 18:46:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-984ac9d1-6967-46c8-ac62-cb6a693bff68 tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18-detach_volume" released by "detach_volume" :: held 0.470s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:06 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:06 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:07 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0" returned: 0 in 2.910s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:07 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[555e746d-4f69-4c4c-9b30-f578d9b41f31]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:07 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0
Apr 13 18:46:07 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:07 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 1.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:07 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:07 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Deleted volume successfully.
Apr 13 18:46:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-319d99a6-f326-4993-b99e-3e62b7dd2fc8 tempest-VolumesListAdminTestJSON-1812115056 None] Lock "cinder-6883ecbb-5972-45d0-b068-8e0bbd3efdbf-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:08 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0" returned: 0 in 0.995s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:08 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0, size 1024.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0 {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:46:08 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Converted 1024.00 MB image at 351.78 MB/s
Apr 13 18:46:08 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0 is being set with open permissions: ugo+rw
Apr 13 18:46:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:08 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0
Apr 13 18:46:08 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:09 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0" returned: 0 in 0.541s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Lock "cinder-quobyte-cd777a40-d85c-4211-81b3-8504ce1a38a0" released by "_copy_volume_from_snapshot" :: held 5.762s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Acquiring lock "cinder-quobyte-70d48128-b141-4744-8d96-fab7186df5c0" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Lock "cinder-quobyte-70d48128-b141-4744-8d96-fab7186df5c0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Deleting offline snapshot 70d48128-b141-4744-8d96-fab7186df5c0 of volume 40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:46:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] snapshot_file for this snap is: volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:46:09 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[924a3a1c-056b-4845-a492-1641221888be]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:09 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0
Apr 13 18:46:09 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:10 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0" returned: 0 in 0.634s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40979783-ecb7-4740-af1c-98440df2bab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:46:10 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[01087707-a679-42d6-99ec-a125f5acc488]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:10 devstack sudo[87556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0
Apr 13 18:46:10 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:10 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0" returned: 0 in 0.573s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:10 devstack sudo[87562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0
Apr 13 18:46:10 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:11 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0" returned: 0 in 0.535s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:11 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0
Apr 13 18:46:11 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:11 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0.70d48128-b141-4744-8d96-fab7186df5c0" returned: 0 in 0.518s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Lock "cinder-quobyte-70d48128-b141-4744-8d96-fab7186df5c0" released by "_delete_snapshot" :: held 2.331s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.721s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6075b0c-6332-44fb-ac40-db5558da2059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd777a40-d85c-4211-81b3-8504ce1a38a0', 'volume_size': 2, 'source_volid': '40979783-ecb7-4740-af1c-98440df2bab0', 'source_volstatus': 'available'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee993851-3c2e-4b83-9a5d-e2b3ac3aea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:11 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Volume volume-cd777a40-d85c-4211-81b3-8504ce1a38a0 (cd777a40-d85c-4211-81b3-8504ce1a38a0): created successfully
Apr 13 18:46:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee993851-3c2e-4b83-9a5d-e2b3ac3aea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Flow 'volume_create_manager' (90e3e7b9-9fd6-4bd7-b176-6d760457a56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:11 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f5f4194e-8794-4baa-803f-18e30fc3e81b tempest-VolumesCloneTest-1386898110 None] Created volume successfully.
Apr 13 18:46:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Acquiring lock "cinder-cd777a40-d85c-4211-81b3-8504ce1a38a0-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Lock "cinder-cd777a40-d85c-4211-81b3-8504ce1a38a0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Acquiring lock "cinder-quobyte-cd777a40-d85c-4211-81b3-8504ce1a38a0" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Lock "cinder-quobyte-cd777a40-d85c-4211-81b3-8504ce1a38a0" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:12 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc676c4-65b9-4b20-ad55-9d5e27922cb1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:12 devstack sudo[87570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0
Apr 13 18:46:12 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:12 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0" returned: 0 in 0.515s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:12 devstack sudo[87575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0
Apr 13 18:46:12 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:13 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd777a40-d85c-4211-81b3-8504ce1a38a0" returned: 0 in 0.466s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Lock "cinder-quobyte-cd777a40-d85c-4211-81b3-8504ce1a38a0" released by "delete_volume" :: held 1.012s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Created reservations ['9421e900-8a26-4ba6-8c9b-d0968d854e2b', '47ab32ed-f029-4021-abae-a9623d349b96', '7f6e9576-c580-40ac-a1c8-f52960444c52', '54b4b4b4-ceaa-4e90-bed6-20f1bb933ce3'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:13 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:13 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Flow 'volume_create_manager' (e57216ea-28d1-4e09-a69a-95968e4cfa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51022a89-8c8b-476f-92c4-af98daa86c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:13 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.449s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Deleted volume successfully.
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51022a89-8c8b-476f-92c4-af98daa86c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1490592980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60595ed7-318e-45ef-bd2e-4f5370c27571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb03fd02d3242f2ad5f4c58fc0b307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:14Z,use_quota=True,user_id='b474732770d44797af2c1348bd8ff11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348679c0-0fb6-4236-ad92-d9a9e9b02204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348679c0-0fb6-4236-ad92-d9a9e9b02204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4816ca-dcd2-43f4-bccf-5355937841cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4816ca-dcd2-43f4-bccf-5355937841cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60595ed7-318e-45ef-bd2e-4f5370c27571', 'volume_name': 'volume-60595ed7-318e-45ef-bd2e-4f5370c27571', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e1d952-9c20-4204-aa23-77fb1a6bbc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e1d952-9c20-4204-aa23-77fb1a6bbc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4e92d0-f22a-421d-b239-9f698d9aa074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:13 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Volume 60595ed7-318e-45ef-bd2e-4f5370c27571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60595ed7-318e-45ef-bd2e-4f5370c27571', 'volume_size': 1}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1490592980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60595ed7-318e-45ef-bd2e-4f5370c27571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb03fd02d3242f2ad5f4c58fc0b307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:14Z,use_quota=True,user_id='b474732770d44797af2c1348bd8ff11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Creating volume 60595ed7-318e-45ef-bd2e-4f5370c27571 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:46:13 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:13 devstack sudo[87588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571 1073741824
Apr 13 18:46:13 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4ae75e3c-5fd1-40ad-9870-9545c45790e3 tempest-VolumesCloneTest-1386898110 None] Lock "cinder-cd777a40-d85c-4211-81b3-8504ce1a38a0-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:14 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571 1073741824" returned: 0 in 0.594s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Acquiring lock "cinder-40979783-ecb7-4740-af1c-98440df2bab0-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Lock "cinder-40979783-ecb7-4740-af1c-98440df2bab0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:14 devstack sudo[87593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571
Apr 13 18:46:14 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Acquiring lock "cinder-quobyte-40979783-ecb7-4740-af1c-98440df2bab0" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Lock "cinder-quobyte-40979783-ecb7-4740-af1c-98440df2bab0" acquired by "delete_volume" :: waited 0.018s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64a0917-6b6f-43ca-a570-b43afd747c7c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:14 devstack sudo[87595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0
Apr 13 18:46:14 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:14 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c4e92d0-f22a-421d-b239-9f698d9aa074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60595ed7-318e-45ef-bd2e-4f5370c27571', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e6a39a-ce1f-47f5-9016-97f294fc0acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:14 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Volume volume-60595ed7-318e-45ef-bd2e-4f5370c27571 (60595ed7-318e-45ef-bd2e-4f5370c27571): created successfully
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e6a39a-ce1f-47f5-9016-97f294fc0acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Flow 'volume_create_manager' (e57216ea-28d1-4e09-a69a-95968e4cfa38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:14 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-592cbe43-c2b4-4058-a350-14d04ea21462 tempest-VolumesTransfersV355Test-1540932569 None] Created volume successfully.
Apr 13 18:46:14 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0" returned: 0 in 0.544s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:14 devstack sudo[87605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0
Apr 13 18:46:14 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:15 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-40979783-ecb7-4740-af1c-98440df2bab0" returned: 0 in 0.459s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Lock "cinder-quobyte-40979783-ecb7-4740-af1c-98440df2bab0" released by "delete_volume" :: held 1.043s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:15 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Created reservations ['fed72805-676d-4fd1-aacf-093f638f3ccb', 'a9b52b15-fcf1-4286-8f4b-0c3668a4535f', '6fed3666-f7c1-4981-9fb4-c5901eb50637', 'fce33f1c-7ab9-4970-b06e-c6f4d7ae3100'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:15 devstack sudo[87609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:15 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:15 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.483s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:16 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:16 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Deleted volume successfully.
Apr 13 18:46:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8092e8fb-173a-4b20-babd-fa4ba960d959 tempest-VolumesCloneTest-1386898110 None] Lock "cinder-40979783-ecb7-4740-af1c-98440df2bab0-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:16 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5a4566de-90a7-4a48-9d17-7ecc8ceef6f8 tempest-VolumesTransfersV355Test-1663273648 None] Transfer volume completed successfully.
Apr 13 18:46:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Acquiring lock "cinder-60595ed7-318e-45ef-bd2e-4f5370c27571-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Lock "cinder-60595ed7-318e-45ef-bd2e-4f5370c27571-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Acquiring lock "cinder-quobyte-60595ed7-318e-45ef-bd2e-4f5370c27571" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Lock "cinder-quobyte-60595ed7-318e-45ef-bd2e-4f5370c27571" acquired by "delete_volume" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:17 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ae3470-302b-4353-9ff0-9142d6426df8]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:17 devstack sudo[87614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571
Apr 13 18:46:17 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:17 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571" returned: 0 in 0.550s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:17 devstack sudo[87619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571
Apr 13 18:46:17 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:18 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-60595ed7-318e-45ef-bd2e-4f5370c27571" returned: 0 in 0.477s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Lock "cinder-quobyte-60595ed7-318e-45ef-bd2e-4f5370c27571" released by "delete_volume" :: held 1.060s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Created reservations ['9ab9173d-382d-4b78-abc8-8601a07df294', '53c6d405-a463-4c2e-b7af-8aede16e0574', '73697820-88c8-45d5-8c4b-1193bee58cc1', 'df948b95-aeb7-488a-b14e-b274221da589'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:18 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:18 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Flow 'volume_create_manager' (01a534c2-0818-4d6e-b57b-ccf6b43d1c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768dae49-3fe0-4be7-b38c-6bc3fa346bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768dae49-3fe0-4be7-b38c-6bc3fa346bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-999484057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2a72ec-ab48-4fe4-833f-ce27583018d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='138de5be280847aba870d58a4c6ffb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:19Z,use_quota=True,user_id='af0037668e804a82b048575f17f5d409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cffbaea-8073-4473-a700-0300bb0354c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cffbaea-8073-4473-a700-0300bb0354c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a310e3b-cd23-43a1-b63a-c90954486390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a310e3b-cd23-43a1-b63a-c90954486390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2a72ec-ab48-4fe4-833f-ce27583018d0', 'volume_name': 'volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2290381c-15d9-44ca-9be4-994012bd266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2290381c-15d9-44ca-9be4-994012bd266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b112ab-32a2-4f1b-94ce-b33403ac1d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:18 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Volume 9b2a72ec-ab48-4fe4-833f-ce27583018d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0', 'volume_size': 1}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-999484057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2a72ec-ab48-4fe4-833f-ce27583018d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='138de5be280847aba870d58a4c6ffb5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:19Z,use_quota=True,user_id='af0037668e804a82b048575f17f5d409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Creating volume 9b2a72ec-ab48-4fe4-833f-ce27583018d0 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:46:18 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:18 devstack sudo[87624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 1073741824
Apr 13 18:46:18 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:18 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.497s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Deleted volume successfully.
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Flow 'volume_create_manager' (a0fe6276-0d1d-4797-a834-cd2e72752ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b5ce5f-08bd-4495-a97e-f2f1109e0620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b5ce5f-08bd-4495-a97e-f2f1109e0620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-457803198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79dae8f-f2b7-4280-9bf8-cd7c0eef0872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ffc12724544274b4e75739ef90ba36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:19Z,use_quota=True,user_id='f5c149965cb54f4198c4b4432b7abac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc2af6f-3b7b-4996-913a-1e82ccfd649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc2af6f-3b7b-4996-913a-1e82ccfd649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d01f37-e903-4bb4-bfb2-18e2881d84d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.image.glance [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Creating Keystone auth plugin from conf {{(pid=82517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 18:46:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5cb55758-a475-47d0-be0a-f42ac28e5f91 tempest-VolumesTransfersV355Test-811366310 None] Lock "cinder-60595ed7-318e-45ef-bd2e-4f5370c27571-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d01f37-e903-4bb4-bfb2-18e2881d84d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e79dae8f-f2b7-4280-9bf8-cd7c0eef0872', 'volume_name': 'volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0bfaf400>}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bccddee-73a4-4496-8a81-3dd36900b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bccddee-73a4-4496-8a81-3dd36900b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc2f689-fd3f-48f3-ae99-de61da31148f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Volume e79dae8f-f2b7-4280-9bf8-cd7c0eef0872: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0bfaf400>}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Trying to clone e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 from image e0058cc9-8f67-429f-9701-e23c6990051f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]). {{(pid=82517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 18:46:19 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 18:46:19 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 1073741824" returned: 0 in 0.602s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb60135-803e-4477-aa73-fb1c55c1131d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:19 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0
Apr 13 18:46:19 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:19 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD
Apr 13 18:46:19 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Flow 'volume_create_manager' (b3cbb353-8a77-4f8c-b215-1e1b6b7de85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21d532f-f974-44a0-9ea3-62b7069ab67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21d532f-f974-44a0-9ea3-62b7069ab67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1073595589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5967b44-0910-4577-bb00-258db7cf057e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb03fd02d3242f2ad5f4c58fc0b307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:20Z,use_quota=True,user_id='b474732770d44797af2c1348bd8ff11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a0368c-656f-4edf-b035-decd91e15783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a0368c-656f-4edf-b035-decd91e15783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0445cb-7927-4d8b-a2ea-c628987644f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0445cb-7927-4d8b-a2ea-c628987644f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5967b44-0910-4577-bb00-258db7cf057e', 'volume_name': 'volume-c5967b44-0910-4577-bb00-258db7cf057e', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8b351a-6e4d-4898-85fe-a0275f93480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8b351a-6e4d-4898-85fe-a0275f93480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de257a18-4d29-410d-a672-a24e76d2eb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Volume c5967b44-0910-4577-bb00-258db7cf057e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5967b44-0910-4577-bb00-258db7cf057e', 'volume_size': 1}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:19 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0" returned: 0 in 0.488s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1073595589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5967b44-0910-4577-bb00-258db7cf057e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb03fd02d3242f2ad5f4c58fc0b307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:20Z,use_quota=True,user_id='b474732770d44797af2c1348bd8ff11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Creating volume c5967b44-0910-4577-bb00-258db7cf057e {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:46:19 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b112ab-32a2-4f1b-94ce-b33403ac1d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:19 devstack sudo[87668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e 1073741824
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25ef295-5557-4e33-9aa0-d6ede57c4ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:19 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Volume volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 (9b2a72ec-ab48-4fe4-833f-ce27583018d0): created successfully
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25ef295-5557-4e33-9aa0-d6ede57c4ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Flow 'volume_create_manager' (01a534c2-0818-4d6e-b57b-ccf6b43d1c8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:19 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-0ae00d61-c3fc-4758-a221-e91aec3451f3 req-31e439bd-96ca-41bb-8525-f2bc0dd75e19 tempest-VolumesSnapshotsTestJSON-1364787195 None] Created volume successfully.
Apr 13 18:46:20 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Temporary image e0058cc9-8f67-429f-9701-e23c6990051f is fetched for user f5c149965cb54f4198c4b4432b7abac1. {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e5ba0b-ea17-4fe6-a4cd-42c8fa4bedd0]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:20 devstack sudo[87675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD
Apr 13 18:46:20 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:20 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e 1073741824" returned: 0 in 0.605s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:20 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e
Apr 13 18:46:20 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:20 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD" returned: 0 in 0.615s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:20 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e" returned: 0 in 0.512s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.175s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-457803198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79dae8f-f2b7-4280-9bf8-cd7c0eef0872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ffc12724544274b4e75739ef90ba36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:19Z,use_quota=True,user_id='f5c149965cb54f4198c4b4432b7abac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Creating volume e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:46:20 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de257a18-4d29-410d-a672-a24e76d2eb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5967b44-0910-4577-bb00-258db7cf057e', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:20 devstack sudo[87688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 1073741824
Apr 13 18:46:20 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4ce93f-9cab-4e37-8217-96c357b8c87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:21 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Volume volume-c5967b44-0910-4577-bb00-258db7cf057e (c5967b44-0910-4577-bb00-258db7cf057e): created successfully
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4ce93f-9cab-4e37-8217-96c357b8c87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Flow 'volume_create_manager' (b3cbb353-8a77-4f8c-b215-1e1b6b7de85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-17460ac7-b8ee-4907-8940-c77b2b27530e tempest-VolumesTransfersV355Test-1540932569 None] Created volume successfully.
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:21 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 1073741824" returned: 0 in 0.523s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:21 devstack sudo[87703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872
Apr 13 18:46:21 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:21 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" returned: 0 in 0.458s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.939s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Creating offline snapshot 856159df-2c78-4445-98b3-13ec97a411fd of volume 9b2a72ec-ab48-4fe4-833f-ce27583018d0 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c1a2f0-9a28-4e31-b086-722a4e5ad19d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Attempting download of e0058cc9-8f67-429f-9701-e23c6990051f ((None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}])) to volume e79dae8f-f2b7-4280-9bf8-cd7c0eef0872. {{(pid=82517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Acquiring lock "cinder-c5967b44-0910-4577-bb00-258db7cf057e-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:22 devstack sudo[87711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0
Apr 13 18:46:22 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Lock "cinder-c5967b44-0910-4577-bb00-258db7cf057e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d85737-fcc0-4327-8dd7-e8ad674883a2]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_21m_3ryi {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Acquiring lock "cinder-quobyte-c5967b44-0910-4577-bb00-258db7cf057e" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Lock "cinder-quobyte-c5967b44-0910-4577-bb00-258db7cf057e" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f182628-2454-4f15-ba8a-7b834dbc3e91]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:22 devstack sudo[87713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_21m_3ryi
Apr 13 18:46:22 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:22 devstack sudo[87714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e
Apr 13 18:46:22 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:22 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0" returned: 0 in 0.508s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:22 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd 1G
Apr 13 18:46:22 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:22 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_21m_3ryi" returned: 0 in 0.476s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_21m_3ryi {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:22 devstack sudo[87727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_21m_3ryi
Apr 13 18:46:22 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:22 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e" returned: 0 in 0.520s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:22 devstack sudo[87729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e
Apr 13 18:46:22 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:23 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd 1G" returned: 0 in 0.509s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:23 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd
Apr 13 18:46:23 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:23 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_21m_3ryi" returned: 1 in 0.571s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_21m_3ryi' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3399f71-9222-4d14-aaf4-10d4db7db03c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:23 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5967b44-0910-4577-bb00-258db7cf057e" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Lock "cinder-quobyte-c5967b44-0910-4577-bb00-258db7cf057e" released by "delete_volume" :: held 1.051s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Created reservations ['019f4737-5b75-4b6e-b974-c81f4e1446bb', '6eb35994-6fc0-4109-9633-e22b357b6ac1', '1da92291-6f40-4900-9b66-53fc36fdcfeb', 'ffce7cf7-f701-4cf0-a450-e482117e21a6'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:23 devstack sudo[87739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD
Apr 13 18:46:23 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:23 devstack sudo[87741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:23 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:23 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd" returned: 0 in 0.462s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:23 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd is being set with open permissions: ugo+rw
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:23 devstack sudo[87746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd
Apr 13 18:46:23 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:23 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] e0058cc9-8f67-429f-9701-e23c6990051f was qcow2, converting to raw {{(pid=82517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:23 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.424s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Deleted volume successfully.
Apr 13 18:46:23 devstack sudo[87753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872
Apr 13 18:46:23 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-94d85520-f921-421c-91a3-f14fd977e10d tempest-VolumesTransfersV355Test-811366310 None] Lock "cinder-c5967b44-0910-4577-bb00-258db7cf057e-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:23 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd" returned: 0 in 0.432s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:23 devstack sudo[87759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.info
Apr 13 18:46:23 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:24 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.info" returned: 0 in 0.598s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:24 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.info is being set with open permissions: ugo+rw
Apr 13 18:46:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:24 devstack sudo[87775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.info
Apr 13 18:46:24 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:24 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" returned: 0 in 0.944s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:24 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_hzq42inldevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:46:24 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Converted 112.00 MB image at 112.00 MB/s
Apr 13 18:46:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:24 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 1G
Apr 13 18:46:24 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:24 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.info" returned: 0 in 0.464s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:25 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-776dc74b-6f87-4e13-94dd-74df5b149163 req-1fbc9f93-a758-4a66-beec-37a9c5794487 tempest-VolumesSnapshotsTestJSON-1364787195 None] Create snapshot completed successfully
Apr 13 18:46:25 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 1G" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dea08e-6f93-4533-876b-0c8704a62aa3]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:25 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872
Apr 13 18:46:25 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Acquiring lock "cinder-856159df-2c78-4445-98b3-13ec97a411fd-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-856159df-2c78-4445-98b3-13ec97a411fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Acquiring lock "cinder-quobyte-9b2a72ec-ab48-4fe4-833f-ce27583018d0" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-quobyte-9b2a72ec-ab48-4fe4-833f-ce27583018d0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Acquiring lock "cinder-quobyte-856159df-2c78-4445-98b3-13ec97a411fd" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-quobyte-856159df-2c78-4445-98b3-13ec97a411fd" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Deleting offline snapshot 856159df-2c78-4445-98b3-13ec97a411fd of volume 9b2a72ec-ab48-4fe4-833f-ce27583018d0 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] snapshot_file for this snap is: volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eea22b9-033b-4e89-bf30-07c802ace359]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:25 devstack sudo[87812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd
Apr 13 18:46:25 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:26 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" returned: 0 in 0.909s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:26 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872
Apr 13 18:46:26 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:26 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd" returned: 0 in 0.860s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd9706-0fec-40a8-84e7-c299e6e48f0e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:26 devstack sudo[87822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0
Apr 13 18:46:26 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:26 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" returned: 1 in 0.759s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Downloaded image e0058cc9-8f67-429f-9701-e23c6990051f ((None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}])) to volume e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 successfully. {{(pid=82517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Temporary image e0058cc9-8f67-429f-9701-e23c6990051f for user f5c149965cb54f4198c4b4432b7abac1 is deleted. {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Marking volume e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 as bootable. {{(pid=82517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Copying metadata from image e0058cc9-8f67-429f-9701-e23c6990051f to e79dae8f-f2b7-4280-9bf8-cd7c0eef0872. {{(pid=82517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Creating volume glance metadata for volume e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 backed by image e0058cc9-8f67-429f-9701-e23c6990051f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc2f689-fd3f-48f3-ae99-de61da31148f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0bfaf400>}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0de59f-9249-4093-8daf-17e5038c0554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:26 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Volume volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 (e79dae8f-f2b7-4280-9bf8-cd7c0eef0872): created successfully
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0de59f-9249-4093-8daf-17e5038c0554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:26 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Flow 'volume_create_manager' (a0fe6276-0d1d-4797-a834-cd2e72752ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:26 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5fdc4bd3-3872-41b7-b666-16191d6feebb tempest-VolumesExtendTest-1698369047 None] Created volume successfully.
Apr 13 18:46:27 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0" returned: 0 in 0.671s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:27 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd
Apr 13 18:46:27 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:27 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d41b778-fab5-45e8-bada-ad1c8c3786dc]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:27 devstack sudo[87832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872
Apr 13 18:46:27 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:27 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd" returned: 0 in 0.585s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:27 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd
Apr 13 18:46:27 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:28 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" returned: 0 in 0.675s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:28 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872
Apr 13 18:46:28 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c03605ab-e0ac-4083-992d-efed5761068f tempest-VolumesActionsTest-449282182 None] Acquiring lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18" by "attach_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c03605ab-e0ac-4083-992d-efed5761068f tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18" acquired by "attach_volume" :: waited 0.020s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:28 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0.856159df-2c78-4445-98b3-13ec97a411fd" returned: 0 in 0.669s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Flow 'volume_create_manager' (6346b41a-4b20-426d-96dd-fe2ed07e64f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff01ce7-fec3-4d00-b10b-ef87db353e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff01ce7-fec3-4d00-b10b-ef87db353e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1522021100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258d650f-b5dd-43fc-acb3-d05532ae3bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f99984c27e342cf85fe791ddf2e5094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:29Z,use_quota=True,user_id='397a8c285a5d419285b75062374d5889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5912fc43-2903-49a0-805d-ab67c5581dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5912fc43-2903-49a0-805d-ab67c5581dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25b656-2dbd-4983-8458-dadfa0a2071c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25b656-2dbd-4983-8458-dadfa0a2071c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258d650f-b5dd-43fc-acb3-d05532ae3bde', 'volume_name': 'volume-258d650f-b5dd-43fc-acb3-d05532ae3bde', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc37afc-20f0-444c-addc-4b10cda75295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc37afc-20f0-444c-addc-4b10cda75295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94d194b-7fb4-45ba-b1e9-65bbad802fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:28 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Volume 258d650f-b5dd-43fc-acb3-d05532ae3bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258d650f-b5dd-43fc-acb3-d05532ae3bde', 'volume_size': 1}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c03605ab-e0ac-4083-992d-efed5761068f tempest-VolumesActionsTest-449282182 None] Attaching volume d64de204-04b7-4a82-b5f0-f8043ca72a18 to instance 4523068c-3719-457a-8d78-a44d3279e243 at mountpoint /dev/vdb on host None.
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-quobyte-856159df-2c78-4445-98b3-13ec97a411fd" released by "_delete_snapshot" :: held 2.970s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c03605ab-e0ac-4083-992d-efed5761068f tempest-VolumesActionsTest-449282182 None] Attach volume completed successfully.
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-quobyte-9b2a72ec-ab48-4fe4-833f-ce27583018d0" released by "delete_snapshot" :: held 2.986s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c03605ab-e0ac-4083-992d-efed5761068f tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18" released by "attach_volume" :: held 0.180s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.quota [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Created reservations ['c22e3b1a-5042-4fc0-a0fe-9eeed6522934', 'f97d9f0f-a9ab-4b6c-a63f-089375f04776', '644777d4-5c3b-4770-ae25-8450fc0c82be', 'd777421c-2aef-4aeb-bcc8-2f2b3d7aa637'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Delete snapshot completed successfully.
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-f6d8730c-33b2-47ee-9fc1-6f8a1921c020 req-7ab40caa-38cc-45eb-9dc2-93cbcfe2503f tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-856159df-2c78-4445-98b3-13ec97a411fd-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:28 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" returned: 1 in 0.671s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 2G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 2G" returned: 0 in 0.045s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.431s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.224s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1522021100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258d650f-b5dd-43fc-acb3-d05532ae3bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f99984c27e342cf85fe791ddf2e5094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:29Z,use_quota=True,user_id='397a8c285a5d419285b75062374d5889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Creating volume 258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:46:28 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:46:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:28 devstack sudo[87851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde 1073741824
Apr 13 18:46:28 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b1be7ebe-7bc2-4cce-88e2-069423dfb14d tempest-VolumesExtendTest-1698369047 None] Extend volume completed successfully.
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Acquiring lock "cinder-9b2a72ec-ab48-4fe4-833f-ce27583018d0-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-9b2a72ec-ab48-4fe4-833f-ce27583018d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Acquiring lock "cinder-quobyte-9b2a72ec-ab48-4fe4-833f-ce27583018d0" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-quobyte-9b2a72ec-ab48-4fe4-833f-ce27583018d0" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd16060-3f06-4772-8aa8-a70a710f8352]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c9cfe2bd-1277-46cb-9c8f-f5ba8faaec79 tempest-VolumesActionsTest-449282182 None] Acquiring lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18-detach_volume" by "detach_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c9cfe2bd-1277-46cb-9c8f-f5ba8faaec79 tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:29 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c9cfe2bd-1277-46cb-9c8f-f5ba8faaec79 tempest-VolumesActionsTest-449282182 None] Detaching volume d64de204-04b7-4a82-b5f0-f8043ca72a18 from instance 4523068c-3719-457a-8d78-a44d3279e243.
Apr 13 18:46:29 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0
Apr 13 18:46:29 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:29 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c9cfe2bd-1277-46cb-9c8f-f5ba8faaec79 tempest-VolumesActionsTest-449282182 None] Detach volume completed successfully.
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c9cfe2bd-1277-46cb-9c8f-f5ba8faaec79 tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18-detach_volume" released by "detach_volume" :: held 0.053s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:29 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde 1073741824" returned: 0 in 0.565s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:29 devstack sudo[87858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde
Apr 13 18:46:29 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:29 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0" returned: 0 in 0.537s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:29 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0
Apr 13 18:46:29 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "cinder-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "cinder-quobyte-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-quobyte-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a6e91-c6cf-4372-be75-f8ca1375969f]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:30 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872
Apr 13 18:46:30 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:30 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde" returned: 0 in 0.658s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94d194b-7fb4-45ba-b1e9-65bbad802fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258d650f-b5dd-43fc-acb3-d05532ae3bde', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b780452-8348-44df-ac7d-4daf6960d456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Volume volume-258d650f-b5dd-43fc-acb3-d05532ae3bde (258d650f-b5dd-43fc-acb3-d05532ae3bde): created successfully
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b780452-8348-44df-ac7d-4daf6960d456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Flow 'volume_create_manager' (6346b41a-4b20-426d-96dd-fe2ed07e64f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:30 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f158c1b6-a20e-46c5-821b-7a2e4e6465aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Created volume successfully.
Apr 13 18:46:30 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-9b2a72ec-ab48-4fe4-833f-ce27583018d0" returned: 0 in 0.672s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-quobyte-9b2a72ec-ab48-4fe4-833f-ce27583018d0" released by "delete_volume" :: held 1.262s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.quota [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Created reservations ['a96e8271-fc76-43cb-b91e-4fe0383b6b0c', '605d759d-95c6-41ab-b763-a2e9185bdef6', '75adffc6-c70a-4321-a8a7-4c693927eba3', 'f2c61900-25a8-4691-85e2-406fdc61d48b'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:30 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:30 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:30 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" returned: 0 in 0.567s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:30 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872
Apr 13 18:46:30 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Creating offline snapshot d0a510ac-96c6-40fe-b829-007261a5d494 of volume 258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e14b754-4307-475f-82af-6fce04adfbf4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:30 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde
Apr 13 18:46:30 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:30 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.447s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.manager [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:30 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Deleted volume successfully.
Apr 13 18:46:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ea124a49-2d42-4c4c-8123-dc247e02d0bd req-da2031f2-409f-4995-9fd0-dc0a718068d4 tempest-VolumesSnapshotsTestJSON-1364787195 None] Lock "cinder-9b2a72ec-ab48-4fe4-833f-ce27583018d0-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:31 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" returned: 1 in 0.543s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:31 devstack sudo[87890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872
Apr 13 18:46:31 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:31 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde" returned: 0 in 0.667s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:31 devstack sudo[87912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 1G
Apr 13 18:46:31 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:31 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" returned: 0 in 0.577s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-quobyte-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872" released by "delete_volume" :: held 1.739s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Created reservations ['b2a4288c-967a-4f8e-a81c-2d5bd9e06200', '776c9ff7-840d-42b7-b4cd-917575bfa304', '0f2f1705-2307-4200-a731-b2b9f972e70a', 'c2386b50-c556-4ad3-a536-f227e0b2dbdd'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:31 devstack sudo[87915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:31 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:32 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 1G" returned: 0 in 0.612s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d650f-b5dd-43fc-acb3-d05532ae3bde -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:32 devstack sudo[87920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d650f-b5dd-43fc-acb3-d05532ae3bde -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494
Apr 13 18:46:32 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:32 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Flow 'volume_create_manager' (01004f70-ad63-48da-be6c-7642800d3604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c455147-4d25-4e08-af09-deff08ed0580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c455147-4d25-4e08-af09-deff08ed0580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-348214020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4438b9-9e77-4baf-8676-b4e2b4acc8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ffc12724544274b4e75739ef90ba36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:32Z,use_quota=True,user_id='f5c149965cb54f4198c4b4432b7abac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8410506-89fa-4ed0-aa42-bc8ea4e26aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8410506-89fa-4ed0-aa42-bc8ea4e26aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91710cd5-bc7f-4753-9b5e-b88786e717e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91710cd5-bc7f-4753-9b5e-b88786e717e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4438b9-9e77-4baf-8676-b4e2b4acc8d4', 'volume_name': 'volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5228a47-65b9-4afe-ba98-a096ba591215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5228a47-65b9-4afe-ba98-a096ba591215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f6b974-e27e-4b31-ab8b-89b304db3a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:32 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Volume 6c4438b9-9e77-4baf-8676-b4e2b4acc8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4', 'volume_size': 1}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.682s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:32 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Deleted volume successfully.
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-17247d8e-3f0e-4477-b099-3d83a11c1012 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-e79dae8f-f2b7-4280-9bf8-cd7c0eef0872-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:32 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d650f-b5dd-43fc-acb3-d05532ae3bde -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494" returned: 0 in 0.571s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:32 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 is being set with open permissions: ugo+rw
Apr 13 18:46:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:32 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494
Apr 13 18:46:32 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:33 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494" returned: 0 in 0.454s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:33 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.info
Apr 13 18:46:33 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:33 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.info" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:33 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.info is being set with open permissions: ugo+rw
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:33 devstack sudo[87935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.info
Apr 13 18:46:33 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Flow 'volume_create_manager' (9bee75ff-2f68-4fed-b809-08f55daa6ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb5ce8a-d61e-4d8e-933e-d983bc7cbe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb5ce8a-d61e-4d8e-933e-d983bc7cbe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-839225528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59d2d7c-0115-413f-8da3-0fa0e6b7e719,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7331938b7f49ff8b4d1b6595ce1ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:34Z,use_quota=True,user_id='b90414c111ed4e17a086bf92d311816a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f84aee0-33f8-43c9-814d-198a3045835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f84aee0-33f8-43c9-814d-198a3045835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094ab2ce-277d-4119-a114-b2cc611a3293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094ab2ce-277d-4119-a114-b2cc611a3293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59d2d7c-0115-413f-8da3-0fa0e6b7e719', 'volume_name': 'volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab2469c-2bf7-43b6-aa66-a7e0bf586351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab2469c-2bf7-43b6-aa66-a7e0bf586351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d338ab67-81f1-4df6-aef3-932950c8b0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:33 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Volume a59d2d7c-0115-413f-8da3-0fa0e6b7e719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719', 'volume_size': 1}
Apr 13 18:46:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:34 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.info" returned: 0 in 0.456s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.312s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-348214020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4438b9-9e77-4baf-8676-b4e2b4acc8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ffc12724544274b4e75739ef90ba36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:32Z,use_quota=True,user_id='f5c149965cb54f4198c4b4432b7abac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Creating volume 6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:46:34 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:34 devstack sudo[87938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 1073741824
Apr 13 18:46:34 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:34 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ce6d304f-a59b-40b4-9897-27919ea0e9f9 tempest-VolumesSnapshotListTestJSON-1484282606 None] Create snapshot completed successfully
Apr 13 18:46:34 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 1073741824" returned: 0 in 0.499s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:34 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4
Apr 13 18:46:34 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:35 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" returned: 0 in 0.440s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-839225528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59d2d7c-0115-413f-8da3-0fa0e6b7e719,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee7331938b7f49ff8b4d1b6595ce1ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:34Z,use_quota=True,user_id='b90414c111ed4e17a086bf92d311816a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Creating volume a59d2d7c-0115-413f-8da3-0fa0e6b7e719 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:46:35 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f6b974-e27e-4b31-ab8b-89b304db3a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8972d9d-474d-49c5-8f42-846e923a4279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:35 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719 1073741824
Apr 13 18:46:35 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:35 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Volume volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 (6c4438b9-9e77-4baf-8676-b4e2b4acc8d4): created successfully
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8972d9d-474d-49c5-8f42-846e923a4279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Flow 'volume_create_manager' (01004f70-ad63-48da-be6c-7642800d3604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:35 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-7728803a-e1db-480d-bf0f-8054d0b07873 tempest-VolumesExtendTest-1698369047 None] Created volume successfully.
Apr 13 18:46:35 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719 1073741824" returned: 0 in 0.532s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:35 devstack sudo[87953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719
Apr 13 18:46:35 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:36 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719" returned: 0 in 0.448s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.037s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d338ab67-81f1-4df6-aef3-932950c8b0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb05b6c-8a36-4474-afff-a2ee2312979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Creating offline snapshot caee524a-4344-473c-892c-1d518d0fa350 of volume 258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:46:36 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Volume volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719 (a59d2d7c-0115-413f-8da3-0fa0e6b7e719): created successfully
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb05b6c-8a36-4474-afff-a2ee2312979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Flow 'volume_create_manager' (9bee75ff-2f68-4fed-b809-08f55daa6ad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb83fb60-1e04-4419-8762-c6b423a9b39d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:36 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-a07beaa5-7848-4d18-a6d9-10747a858b9b req-0b3b81bf-8410-4ec8-ab48-20e633229dc8 tempest-VolumesGetTestJSON-1543813853 None] Created volume successfully.
Apr 13 18:46:36 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494
Apr 13 18:46:36 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:36 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494" returned: 0 in 0.471s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258d650f-b5dd-43fc-acb3-d05532ae3bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:46:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:36 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 1G
Apr 13 18:46:36 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:37 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 1G" returned: 0 in 0.523s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:37 devstack sudo[87966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350
Apr 13 18:46:37 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Acquiring lock "cinder-a59d2d7c-0115-413f-8da3-0fa0e6b7e719-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Lock "cinder-a59d2d7c-0115-413f-8da3-0fa0e6b7e719-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Acquiring lock "cinder-quobyte-a59d2d7c-0115-413f-8da3-0fa0e6b7e719" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Lock "cinder-quobyte-a59d2d7c-0115-413f-8da3-0fa0e6b7e719" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a802f6-2a23-4d00-b6fd-12e162085aa4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:37 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719
Apr 13 18:46:37 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:37 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350" returned: 0 in 0.452s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:37 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 is being set with open permissions: ugo+rw
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:37 devstack sudo[87973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350
Apr 13 18:46:37 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:37 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719" returned: 0 in 0.574s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:37 devstack sudo[87978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719
Apr 13 18:46:37 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:38 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350" returned: 0 in 0.436s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.419s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Creating offline snapshot f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 of volume 6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:46:38 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-16bff3a8-6e9d-4adb-8407-8bb4a8a864aa tempest-VolumesSnapshotListTestJSON-1484282606 None] Create snapshot completed successfully
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13e9439-8d02-4a21-9b08-cf4731ee415d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:38 devstack sudo[87981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4
Apr 13 18:46:38 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:38 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a59d2d7c-0115-413f-8da3-0fa0e6b7e719" returned: 0 in 0.514s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Lock "cinder-quobyte-a59d2d7c-0115-413f-8da3-0fa0e6b7e719" released by "delete_volume" :: held 1.109s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG cinder.quota [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Created reservations ['1eea579c-0208-49ae-952e-8b7d623dc58f', 'f3b0d879-d4ef-46a4-b364-d301af30afc9', '7921d306-6686-4473-be24-22f4a5a6c23e', '9b468be6-60ea-45cf-a419-439b78b98fb3'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:38 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:46:38 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:38 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" returned: 0 in 0.557s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:38 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 1G
Apr 13 18:46:38 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:38 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.411s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG cinder.manager [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:46:38 devstack cinder-volume[82517]: INFO cinder.volume.manager [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Deleted volume successfully.
Apr 13 18:46:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [req-ca165c7a-4955-4d32-9aca-98b47b44876f req-62fde148-5369-4361-abfa-3868f8fa9660 tempest-VolumesGetTestJSON-1543813853 None] Lock "cinder-a59d2d7c-0115-413f-8da3-0fa0e6b7e719-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:39 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 1G" returned: 0 in 0.464s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:39 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24
Apr 13 18:46:39 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:39 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24" returned: 0 in 0.437s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:39 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 is being set with open permissions: ugo+rw
Apr 13 18:46:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:39 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24
Apr 13 18:46:39 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:40 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24" returned: 0 in 0.444s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:40 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.info
Apr 13 18:46:40 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:40 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.info" returned: 0 in 0.474s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:40 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.info is being set with open permissions: ugo+rw
Apr 13 18:46:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:40 devstack sudo[88006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.info
Apr 13 18:46:40 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:40 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.info" returned: 0 in 0.439s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.738s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:40 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e083a811-bac8-4a85-99bd-18bdd43e2ea3]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:40 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-59be3060-e079-41d1-a9df-eeb6d154ae98 tempest-VolumesExtendTest-1698369047 None] Create snapshot completed successfully
Apr 13 18:46:41 devstack sudo[88009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18
Apr 13 18:46:41 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:41 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18" returned: 0 in 0.531s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4b3681-e35e-44ee-9fd9-93b9708d0034]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Flow 'volume_create_manager' (fd24e959-cd99-42c2-9ca2-678e9f24d591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220658c7-37ba-44ac-862e-19c5e95eff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220658c7-37ba-44ac-862e-19c5e95eff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1851525889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08559e41-3c52-49c3-be01-eb18952a4cfe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='987adb66a6774d65843e306556fc10ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:41Z,use_quota=True,user_id='19a2deb0c26e4c22b8313dc0108f2329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f11037-92bd-4272-9eeb-ccb834a0e7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:41 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18
Apr 13 18:46:41 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f11037-92bd-4272-9eeb-ccb834a0e7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6fce04-d52f-4da8-a7b8-888cf4493286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6fce04-d52f-4da8-a7b8-888cf4493286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08559e41-3c52-49c3-be01-eb18952a4cfe', 'volume_name': 'volume-08559e41-3c52-49c3-be01-eb18952a4cfe', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452fc56d-94e1-4c99-8f57-d6b2e02d76c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452fc56d-94e1-4c99-8f57-d6b2e02d76c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9e8b54-e6a5-4cd2-8147-2103f2f1c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:41 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Volume 08559e41-3c52-49c3-be01-eb18952a4cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08559e41-3c52-49c3-be01-eb18952a4cfe', 'volume_size': 1}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0d0f23f9-f2a9-4cb6-8e3c-925f28df63f3 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:41 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18" returned: 0 in 0.483s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.5b101618-70c8-4464-8827-7c932e17c764t0jqoyc5.img {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:42 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.5b101618-70c8-4464-8827-7c932e17c764t0jqoyc5.img
Apr 13 18:46:42 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:43 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.5b101618-70c8-4464-8827-7c932e17c764t0jqoyc5.img" returned: 0 in 1.890s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:43 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c44c611-a3c2-49bf-ac65-e6e9a619a162]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:43 devstack sudo[88033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18
Apr 13 18:46:43 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:44 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18" returned: 0 in 0.590s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:44 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.5b101618-70c8-4464-8827-7c932e17c764t0jqoyc5.img {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:46:44 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Converted 1024.00 MB image at 541.21 MB/s
Apr 13 18:46:44 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] 5b101618-70c8-4464-8827-7c932e17c764 was raw, no need to convert to raw {{(pid=82517) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 13 18:46:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.771s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Uploaded volume to glance image-id: 5b101618-70c8-4464-8827-7c932e17c764. {{(pid=82517) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 13 18:46:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.429s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Creating offline snapshot 2de84b3b-a902-4d6a-8076-03912534b6d1 of volume 258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:46:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-743d1375-b5e1-4d21-a4fb-844210aed9de tempest-VolumesActionsTest-449282182 None] Copy volume to image completed successfully.
Apr 13 18:46:53 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccd2a9d-492a-4f4b-bece-e2af4666376f]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:53 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350
Apr 13 18:46:53 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:54 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350" returned: 0 in 0.474s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258d650f-b5dd-43fc-acb3-d05532ae3bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:46:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:54 devstack sudo[88051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 1G
Apr 13 18:46:54 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:54 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:UPDATE=159,cinder:SELECT=129,cinder:DELETE=14,cinder:INSERT=43 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:46:54 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 1G" returned: 0 in 0.513s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:54 devstack sudo[88056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1
Apr 13 18:46:54 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=133,cinder:INSERT=42,cinder:UPDATE=146,cinder:DELETE=13 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:55 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1" returned: 0 in 0.453s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:55 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 is being set with open permissions: ugo+rw
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:55 devstack sudo[88061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1
Apr 13 18:46:55 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:55 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1" returned: 0 in 0.408s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.041s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1851525889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08559e41-3c52-49c3-be01-eb18952a4cfe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='987adb66a6774d65843e306556fc10ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:41Z,use_quota=True,user_id='19a2deb0c26e4c22b8313dc0108f2329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Creating volume 08559e41-3c52-49c3-be01-eb18952a4cfe {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:46:55 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:46:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:55 devstack sudo[88064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe 1073741824
Apr 13 18:46:55 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:55 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-210de705-62c3-47a4-a8f7-55f4d17511dc tempest-VolumesSnapshotListTestJSON-1484282606 None] Create snapshot completed successfully
Apr 13 18:46:56 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe 1073741824" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:56 devstack sudo[88069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe
Apr 13 18:46:56 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-2de84b3b-a902-4d6a-8076-03912534b6d1-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-2de84b3b-a902-4d6a-8076-03912534b6d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-quobyte-2de84b3b-a902-4d6a-8076-03912534b6d1" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-2de84b3b-a902-4d6a-8076-03912534b6d1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Deleting offline snapshot 2de84b3b-a902-4d6a-8076-03912534b6d1 of volume 258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] snapshot_file for this snap is: volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[74be1c8f-5bf0-4af1-becb-54b8bee68942]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:56 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1
Apr 13 18:46:56 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:56 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe" returned: 0 in 0.419s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0d0f23f9-f2a9-4cb6-8e3c-925f28df63f3 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 14.695s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9e8b54-e6a5-4cd2-8147-2103f2f1c30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08559e41-3c52-49c3-be01-eb18952a4cfe', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ebc884-8322-4e50-b014-12d2ccd64115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e030eec0-e026-4f31-92f9-a925ffe14ab3]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0d0f23f9-f2a9-4cb6-8e3c-925f28df63f3 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:56 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Volume volume-08559e41-3c52-49c3-be01-eb18952a4cfe (08559e41-3c52-49c3-be01-eb18952a4cfe): created successfully
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ebc884-8322-4e50-b014-12d2ccd64115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Flow 'volume_create_manager' (fd24e959-cd99-42c2-9ca2-678e9f24d591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-13ed4267-a70f-459b-8e07-430215a28f45 tempest-VolumesTestJSON-545421089 None] Created volume successfully.
Apr 13 18:46:56 devstack sudo[88074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4
Apr 13 18:46:56 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:56 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1" returned: 0 in 0.479s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258d650f-b5dd-43fc-acb3-d05532ae3bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e402a-e473-4fbd-81df-3242052ae62c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:56 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350
Apr 13 18:46:56 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:57 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0d0f23f9-f2a9-4cb6-8e3c-925f28df63f3 tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" returned: 0 in 0.467s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0d0f23f9-f2a9-4cb6-8e3c-925f28df63f3 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 2G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0d0f23f9-f2a9-4cb6-8e3c-925f28df63f3 tempest-VolumesExtendTest-1698369047 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 2G" returned: 0 in 0.073s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0d0f23f9-f2a9-4cb6-8e3c-925f28df63f3 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.564s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.015s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb675952-26de-4582-b59a-fc55b73763fb]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:57 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-0d0f23f9-f2a9-4cb6-8e3c-925f28df63f3 tempest-VolumesExtendTest-1698369047 None] Extend volume completed successfully.
Apr 13 18:46:57 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18
Apr 13 18:46:57 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:57 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350" returned: 0 in 0.519s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258d650f-b5dd-43fc-acb3-d05532ae3bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:57 devstack sudo[88092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1
Apr 13 18:46:57 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Flow 'volume_create_manager' (b24b8ecb-d07a-4cfe-bded-e76e76cb1a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1faa80c-f4cd-4062-9a2c-5b49a673095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:57 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18" returned: 0 in 0.586s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cf4106-48fb-42ae-ba30-37e4d819e156]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1faa80c-f4cd-4062-9a2c-5b49a673095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-340443655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b7bb67-b6f1-4d4f-91af-ad366200bc61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='987adb66a6774d65843e306556fc10ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:58Z,use_quota=True,user_id='19a2deb0c26e4c22b8313dc0108f2329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637703ac-dc8e-4f31-9c55-500b2a50ef2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637703ac-dc8e-4f31-9c55-500b2a50ef2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64df3252-ca76-4f6c-8d4a-563fc28c8ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64df3252-ca76-4f6c-8d4a-563fc28c8ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02b7bb67-b6f1-4d4f-91af-ad366200bc61', 'volume_name': 'volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7633fada-e74f-406d-b6af-8e09ba3482f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7633fada-e74f-406d-b6af-8e09ba3482f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b95804b-dc95-4ca0-9f46-ffe1a348432b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:46:57 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Volume 02b7bb67-b6f1-4d4f-91af-ad366200bc61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61', 'volume_size': 1}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "cinder-f7ea6c7a-b468-4e05-b9bf-8369dcc4da24-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-f7ea6c7a-b468-4e05-b9bf-8369dcc4da24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "cinder-quobyte-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-quobyte-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "cinder-quobyte-f7ea6c7a-b468-4e05-b9bf-8369dcc4da24" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:57 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18
Apr 13 18:46:57 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-quobyte-f7ea6c7a-b468-4e05-b9bf-8369dcc4da24" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Deleting offline snapshot f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 of volume 6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] snapshot_file for this snap is: volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[381abc8b-dba8-4db0-b67d-5e770ee524b9]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:57 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24
Apr 13 18:46:57 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:58 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1" returned: 0 in 0.552s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:58 devstack sudo[88104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1
Apr 13 18:46:58 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:58 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18" returned: 0 in 0.520s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:58 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img
Apr 13 18:46:58 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:58 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24" returned: 0 in 0.526s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef4340d-dad2-4bbf-b23f-9065bc13564e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:58 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.2de84b3b-a902-4d6a-8076-03912534b6d1" returned: 0 in 0.441s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-2de84b3b-a902-4d6a-8076-03912534b6d1" released by "_delete_snapshot" :: held 2.033s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" released by "delete_snapshot" :: held 2.045s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:58 devstack sudo[88115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4
Apr 13 18:46:58 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:58 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:46:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:46:58 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24
Apr 13 18:46:58 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Created reservations ['e0a0fdd1-5c9f-4a47-a3c4-4e595db3b61b', '1b9dd87a-89ed-4897-a98d-136805327cbb', '24fd62ff-9690-4387-b8fb-5032f0a8e353', '0403487f-fa03-4839-947b-d3df0eb69220'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:46:59 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Delete snapshot completed successfully.
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f60b3c4-03c9-4073-af8a-f917df3d96df tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-2de84b3b-a902-4d6a-8076-03912534b6d1-delete_snapshot" released by "delete_snapshot" :: held 2.889s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-caee524a-4344-473c-892c-1d518d0fa350-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-caee524a-4344-473c-892c-1d518d0fa350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" acquired by "delete_snapshot" :: waited 0.054s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-quobyte-caee524a-4344-473c-892c-1d518d0fa350" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-caee524a-4344-473c-892c-1d518d0fa350" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Deleting offline snapshot caee524a-4344-473c-892c-1d518d0fa350 of volume 258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] snapshot_file for this snap is: volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd062d2-6ba2-4833-9cd4-4a390156c589]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:46:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:00 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350
Apr 13 18:47:00 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:00 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24" returned: 0 in 1.177s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:00 devstack sudo[88137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24
Apr 13 18:47:00 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:00 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img" returned: 0 in 2.440s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[673cef98-a47a-4284-844d-dd2bb42926e2]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:00 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18
Apr 13 18:47:00 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:00 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350" returned: 0 in 1.029s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258d650f-b5dd-43fc-acb3-d05532ae3bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c97c436-e79a-4dcd-a509-3e9221e46336]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_service.periodic_task [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:00 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4.f7ea6c7a-b468-4e05-b9bf-8369dcc4da24" returned: 0 in 0.806s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:00 devstack sudo[88146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:00 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-quobyte-f7ea6c7a-b468-4e05-b9bf-8369dcc4da24" released by "_delete_snapshot" :: held 3.079s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-quobyte-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" released by "delete_snapshot" :: held 3.093s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:00 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494
Apr 13 18:47:00 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:00 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Created reservations ['01c687fe-0eae-4418-8638-2bf8c52620ae', '1b92a2ef-53c4-4f32-aeef-6e373b4cb6a7', 'bc6297dc-33d1-467e-90f7-785ad295598d', '46c33564-88e5-4b30-8943-e89780daf424'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:01 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Delete snapshot completed successfully.
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd829163-9b7a-460a-a5c6-f124a209e6a9 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-f7ea6c7a-b468-4e05-b9bf-8369dcc4da24-delete_snapshot" released by "delete_snapshot" :: held 3.172s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:01 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.432s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:01 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494" returned: 0 in 0.500s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258d650f-b5dd-43fc-acb3-d05532ae3bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:01 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350
Apr 13 18:47:01 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:01 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18" returned: 0 in 0.660s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:47:01 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Converted 1024.00 MB image at 419.50 MB/s
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] 9f20bfb4-3e87-42a3-b3ff-3e267ea4a287 was raw, converting to qcow2 {{(pid=82517) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f0726c-862b-4f45-a006-5f9dd2fd88e3]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:01 devstack sudo[88158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img
Apr 13 18:47:01 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:01 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350" returned: 0 in 0.481s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:01 devstack sudo[88165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350
Apr 13 18:47:01 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:01 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img" returned: 0 in 0.464s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:01 devstack sudo[88167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img
Apr 13 18:47:01 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "cinder-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "cinder-quobyte-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-quobyte-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1130b008-f3eb-4be1-8f8e-f1a583e45e61]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:02 devstack sudo[88169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4
Apr 13 18:47:02 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:02 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.caee524a-4344-473c-892c-1d518d0fa350" returned: 0 in 0.460s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-caee524a-4344-473c-892c-1d518d0fa350" released by "_delete_snapshot" :: held 2.554s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" released by "delete_snapshot" :: held 2.599s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Created reservations ['06a06cbd-ac41-48a2-b8fd-26592af8176d', '75fa2455-d328-4df9-ae8d-c3936589a7c2', '507bd521-df23-4a3b-b023-0ac457958f31', '8c81ef20-3394-419d-bf2d-45f5441db85f'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:02 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img" returned: 1 in 0.496s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img /opt/stack/data/cinder/conversion/vol_upload_dba_zkxx {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:02 devstack sudo[88175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img /opt/stack/data/cinder/conversion/vol_upload_dba_zkxx
Apr 13 18:47:02 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:02 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Delete snapshot completed successfully.
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7e882589-bc06-44dd-a302-4d9492480547 tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-caee524a-4344-473c-892c-1d518d0fa350-delete_snapshot" released by "delete_snapshot" :: held 2.764s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:02 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" returned: 0 in 0.476s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:02 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4
Apr 13 18:47:02 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:02 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img /opt/stack/data/cinder/conversion/vol_upload_dba_zkxx" returned: 0 in 0.416s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Image conversion details: src /opt/stack/data/cinder/conversion/d64de204-04b7-4a82-b5f0-f8043ca72a18.temp_image.9f20bfb4-3e87-42a3-b3ff-3e267ea4a287yi4dsk3j.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dba_zkxx {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:47:02 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bf2fad-d19d-4f94-85e0-fbdef2c3faf0]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dba_zkxx {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-d0a510ac-96c6-40fe-b829-007261a5d494-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-d0a510ac-96c6-40fe-b829-007261a5d494-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-quobyte-d0a510ac-96c6-40fe-b829-007261a5d494" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-d0a510ac-96c6-40fe-b829-007261a5d494" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Deleting offline snapshot d0a510ac-96c6-40fe-b829-007261a5d494 of volume 258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] snapshot_file for this snap is: volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee93d7d-0d49-4b78-9c5d-de9924c3b547]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:02 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dba_zkxx
Apr 13 18:47:02 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:02 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494
Apr 13 18:47:02 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:03 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" returned: 0 in 0.439s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-quobyte-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4" released by "delete_volume" :: held 0.950s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Created reservations ['c63724c5-8ee8-4fbd-a250-23c4e822bd4d', '53ab1509-0bef-4a8b-842f-30854e245536', 'a2316073-4c99-4210-b63a-d2e09bc28fa8', 'b592f1ef-7dd9-4188-8d25-45d2a85baa32'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:03 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:03 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:03 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dba_zkxx" returned: 0 in 0.536s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:03 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494" returned: 0 in 0.530s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258d650f-b5dd-43fc-acb3-d05532ae3bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[40523b11-8faf-4faf-979e-abc324f8225c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:03 devstack sudo[88198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde
Apr 13 18:47:03 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:03 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.472s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:03 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Deleted volume successfully.
Apr 13 18:47:03 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b61d5759-677c-4655-8d89-29b194340a95 tempest-VolumesExtendTest-1698369047 None] Lock "cinder-6c4438b9-9e77-4baf-8676-b4e2b4acc8d4-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:04 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde" returned: 0 in 0.649s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:04 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494
Apr 13 18:47:04 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.183s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Uploaded volume to glance image-id: 9f20bfb4-3e87-42a3-b3ff-3e267ea4a287. {{(pid=82517) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.546s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-340443655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b7bb67-b6f1-4d4f-91af-ad366200bc61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='987adb66a6774d65843e306556fc10ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:46:58Z,use_quota=True,user_id='19a2deb0c26e4c22b8313dc0108f2329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Creating volume 02b7bb67-b6f1-4d4f-91af-ad366200bc61 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:04 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:04 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-7b8f4f70-c324-49a2-a85c-e56cd2eccddf tempest-VolumesActionsTest-449282182 None] Copy volume to image completed successfully.
Apr 13 18:47:04 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61 1073741824
Apr 13 18:47:04 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:04 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494" returned: 0 in 0.607s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:04 devstack sudo[88212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494
Apr 13 18:47:04 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:04 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61 1073741824" returned: 0 in 0.573s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Acquiring lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:05 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61
Apr 13 18:47:05 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Acquiring lock "cinder-quobyte-d64de204-04b7-4a82-b5f0-f8043ca72a18" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Lock "cinder-quobyte-d64de204-04b7-4a82-b5f0-f8043ca72a18" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb07e92-9db0-4ca6-b517-be75e8a2fbb1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:05 devstack sudo[88219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18
Apr 13 18:47:05 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:05 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde.d0a510ac-96c6-40fe-b829-007261a5d494" returned: 0 in 0.496s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-d0a510ac-96c6-40fe-b829-007261a5d494" released by "_delete_snapshot" :: held 2.343s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" released by "delete_snapshot" :: held 2.357s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Flow 'volume_create_manager' (9e569085-f8f2-4865-b2b0-f32be88299b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a111be-13e1-498e-b826-5a8bbbc8a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a111be-13e1-498e-b826-5a8bbbc8a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-544091483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48f5dfb-3670-4abb-bf73-b93770f93c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0f7cb71d714d4bbeed01bef54776ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:05Z,use_quota=True,user_id='a8a524edbf5d460eb4cd5066ca52cbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789154bf-ca0f-464d-a2bd-f9c40522fa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789154bf-ca0f-464d-a2bd-f9c40522fa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d588681b-ad78-42e3-bcc5-7348a4baaa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d588681b-ad78-42e3-bcc5-7348a4baaa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e48f5dfb-3670-4abb-bf73-b93770f93c2c', 'volume_name': 'volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e5ab4f-5818-4172-8458-15c37592aa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e5ab4f-5818-4172-8458-15c37592aa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c0b421-1b50-4a78-a3e1-3a9f97b3ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:05 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Volume e48f5dfb-3670-4abb-bf73-b93770f93c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c', 'volume_size': 1}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Created reservations ['46773570-948b-457d-9c6b-226c0155aa52', 'e9730d7e-e390-48e9-b2e4-66a207866826', '6d64dde6-274b-4800-92bd-1b2c53c5fdba', '57d5e84a-0b09-4418-b065-66b5450f2553'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Delete snapshot completed successfully.
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4125fa4c-e0a0-469f-a28b-a45bf12dbe3a tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-d0a510ac-96c6-40fe-b829-007261a5d494-delete_snapshot" released by "delete_snapshot" :: held 2.506s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:05 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61" returned: 0 in 0.551s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.208s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-544091483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48f5dfb-3670-4abb-bf73-b93770f93c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d0f7cb71d714d4bbeed01bef54776ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:05Z,use_quota=True,user_id='a8a524edbf5d460eb4cd5066ca52cbd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Creating volume e48f5dfb-3670-4abb-bf73-b93770f93c2c {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:05 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b95804b-dc95-4ca0-9f46-ffe1a348432b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:05 devstack sudo[88226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c 1073741824
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e201b96b-313e-4ac4-be3c-ac37533169d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:05 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:05 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Volume volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61 (02b7bb67-b6f1-4d4f-91af-ad366200bc61): created successfully
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e201b96b-313e-4ac4-be3c-ac37533169d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:05 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Flow 'volume_create_manager' (b24b8ecb-d07a-4cfe-bded-e76e76cb1a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18" returned: 0 in 0.516s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-81d3d5bb-e4e6-48f9-80aa-884f3ef9ed13 tempest-VolumesTestJSON-545421089 None] Created volume successfully.
Apr 13 18:47:05 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18
Apr 13 18:47:05 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:06 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d64de204-04b7-4a82-b5f0-f8043ca72a18" returned: 0 in 0.447s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:06 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c 1073741824" returned: 0 in 0.496s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Lock "cinder-quobyte-d64de204-04b7-4a82-b5f0-f8043ca72a18" released by "delete_volume" :: held 0.988s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-258d650f-b5dd-43fc-acb3-d05532ae3bde-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-258d650f-b5dd-43fc-acb3-d05532ae3bde-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:06 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c
Apr 13 18:47:06 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Created reservations ['d11ca793-5175-4912-8940-1d3c186c5872', '80489422-c034-4be1-9719-e1019e403242', '5ab8c1bb-0a69-4073-9544-8ac274f1ec15', '103233cc-fbb1-4746-a8f6-a9d962d35632'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" acquired by "delete_volume" :: waited 0.050s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ae78ec-f1f2-48c0-a996-c417547d22dd]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:06 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:06 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:06 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde
Apr 13 18:47:06 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:06 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c" returned: 0 in 0.476s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c0b421-1b50-4a78-a3e1-3a9f97b3ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fa40e5-71e7-485c-8f9e-4dbd7cee75d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:06 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Volume volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c (e48f5dfb-3670-4abb-bf73-b93770f93c2c): created successfully
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fa40e5-71e7-485c-8f9e-4dbd7cee75d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Flow 'volume_create_manager' (9e569085-f8f2-4865-b2b0-f32be88299b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:06 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3fe2cb86-6c91-43db-8e62-29249506808a tempest-VolumesNegativeTest-345687444 None] Created volume successfully.
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Flow 'volume_create_manager' (f1c81489-0976-4faa-85d3-dfff69f93ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cdf77cb-3db9-496d-b989-aad4c017875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cdf77cb-3db9-496d-b989-aad4c017875c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1974613791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df58997-5502-478b-8de0-787ee21b2223,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='987adb66a6774d65843e306556fc10ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:07Z,use_quota=True,user_id='19a2deb0c26e4c22b8313dc0108f2329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87ea976-5a34-4f34-837f-2fa465ed1122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87ea976-5a34-4f34-837f-2fa465ed1122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cc63ac-af91-4074-bc03-ce3f2fa30cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cc63ac-af91-4074-bc03-ce3f2fa30cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df58997-5502-478b-8de0-787ee21b2223', 'volume_name': 'volume-7df58997-5502-478b-8de0-787ee21b2223', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56b9e16-16c6-4766-b438-102e5633b0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56b9e16-16c6-4766-b438-102e5633b0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026a6acd-61b8-4033-87ba-da17ccfcdb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:06 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Volume 7df58997-5502-478b-8de0-787ee21b2223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df58997-5502-478b-8de0-787ee21b2223', 'volume_size': 1}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1974613791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df58997-5502-478b-8de0-787ee21b2223,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='987adb66a6774d65843e306556fc10ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:07Z,use_quota=True,user_id='19a2deb0c26e4c22b8313dc0108f2329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Creating volume 7df58997-5502-478b-8de0-787ee21b2223 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:06 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:06 devstack sudo[88243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223 1073741824
Apr 13 18:47:06 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:06 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.533s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:06 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Deleted volume successfully.
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9b04b26e-993f-4b44-b1a4-5550c72e8e4d tempest-VolumesActionsTest-449282182 None] Lock "cinder-d64de204-04b7-4a82-b5f0-f8043ca72a18-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:06 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde" returned: 0 in 0.553s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:06 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde
Apr 13 18:47:06 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:07 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223 1073741824" returned: 0 in 0.531s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:07 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-258d650f-b5dd-43fc-acb3-d05532ae3bde" returned: 0 in 0.439s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-quobyte-258d650f-b5dd-43fc-acb3-d05532ae3bde" released by "delete_volume" :: held 1.029s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:07 devstack sudo[88254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223
Apr 13 18:47:07 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Created reservations ['0d1938c1-1a6b-448d-a0dc-28a753627281', '436c516d-4094-4334-a486-2b1c12d511a8', '0438a2b2-337e-4ca5-adaf-bfdd2d47de29', 'ef3ddcb6-f233-4161-892f-7b4fbd08531b'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:07 devstack sudo[88256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:07 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:07 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223" returned: 0 in 0.527s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026a6acd-61b8-4033-87ba-da17ccfcdb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df58997-5502-478b-8de0-787ee21b2223', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c25ed5d-136a-4e74-9001-7464a00378e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:07 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Volume volume-7df58997-5502-478b-8de0-787ee21b2223 (7df58997-5502-478b-8de0-787ee21b2223): created successfully
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c25ed5d-136a-4e74-9001-7464a00378e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Flow 'volume_create_manager' (f1c81489-0976-4faa-85d3-dfff69f93ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:07 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e7986730-e1a4-4fb4-b51a-756a99637900 tempest-VolumesTestJSON-545421089 None] Created volume successfully.
Apr 13 18:47:07 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.527s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:07 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Deleted volume successfully.
Apr 13 18:47:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5c9559bc-e47c-42a3-b79d-87af90966f0e tempest-VolumesSnapshotListTestJSON-1484282606 None] Lock "cinder-258d650f-b5dd-43fc-acb3-d05532ae3bde-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Acquiring lock "cinder-7df58997-5502-478b-8de0-787ee21b2223-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Lock "cinder-7df58997-5502-478b-8de0-787ee21b2223-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Acquiring lock "cinder-quobyte-7df58997-5502-478b-8de0-787ee21b2223" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Lock "cinder-quobyte-7df58997-5502-478b-8de0-787ee21b2223" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:09 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c06982a-8882-49c2-bfb0-e7169431745a]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:09 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223
Apr 13 18:47:09 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:10 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223" returned: 0 in 0.633s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:10 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223
Apr 13 18:47:10 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Flow 'volume_create_manager' (2731196e-cf13-4063-8360-a243a7397e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedf333c-c3be-4c23-9aa0-b889f4210499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedf333c-c3be-4c23-9aa0-b889f4210499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1022626334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2071a059-ba27-4bf6-9635-884ba1edadb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c102f060bc1d446c95f7e7c635e37a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:10Z,use_quota=True,user_id='c338735f3fcb4a91aa80319b8ecb7171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1125947a-b658-403d-b34f-ac81a63e3fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1125947a-b658-403d-b34f-ac81a63e3fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63abd11-925e-4c7a-9eb1-6a449afc66c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63abd11-925e-4c7a-9eb1-6a449afc66c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2071a059-ba27-4bf6-9635-884ba1edadb3', 'volume_name': 'volume-2071a059-ba27-4bf6-9635-884ba1edadb3', 'volume_size': 2}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648f6591-dc9b-48c5-bc57-3188ece0ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648f6591-dc9b-48c5-bc57-3188ece0ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42023aae-25a6-4207-b54a-37e5ff23fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:10 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Volume 2071a059-ba27-4bf6-9635-884ba1edadb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2071a059-ba27-4bf6-9635-884ba1edadb3', 'volume_size': 2}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1022626334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2071a059-ba27-4bf6-9635-884ba1edadb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c102f060bc1d446c95f7e7c635e37a68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:10Z,use_quota=True,user_id='c338735f3fcb4a91aa80319b8ecb7171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Creating volume 2071a059-ba27-4bf6-9635-884ba1edadb3 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:10 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3 2147483648 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:10 devstack sudo[88274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3 2147483648
Apr 13 18:47:10 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:10 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-7df58997-5502-478b-8de0-787ee21b2223" returned: 0 in 0.495s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Lock "cinder-quobyte-7df58997-5502-478b-8de0-787ee21b2223" released by "delete_volume" :: held 1.158s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Created reservations ['88e6bf06-b8e3-4ace-a4e9-1199bb21fb48', 'e51ef7cc-9d52-4faa-b443-2b35e49f21aa', '17ad605a-9ecd-44d8-9b6b-7a80b4d016b8', '061c3c13-f613-4865-9568-bf0954daa720'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:10 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:10 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:11 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.447s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:11 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Deleted volume successfully.
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-63b06907-a378-4467-8d14-33a422eaa1e1 tempest-VolumesTestJSON-545421089 None] Lock "cinder-7df58997-5502-478b-8de0-787ee21b2223-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:11 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3 2147483648" returned: 0 in 0.644s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:11 devstack sudo[88282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3
Apr 13 18:47:11 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Acquiring lock "cinder-02b7bb67-b6f1-4d4f-91af-ad366200bc61-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Lock "cinder-02b7bb67-b6f1-4d4f-91af-ad366200bc61-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:11 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3" returned: 0 in 0.506s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Acquiring lock "cinder-quobyte-02b7bb67-b6f1-4d4f-91af-ad366200bc61" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42023aae-25a6-4207-b54a-37e5ff23fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2071a059-ba27-4bf6-9635-884ba1edadb3', 'volume_size': 2}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a56525-0119-4d89-bd2c-78e296796fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Lock "cinder-quobyte-02b7bb67-b6f1-4d4f-91af-ad366200bc61" acquired by "delete_volume" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:11 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Volume volume-2071a059-ba27-4bf6-9635-884ba1edadb3 (2071a059-ba27-4bf6-9635-884ba1edadb3): created successfully
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a56525-0119-4d89-bd2c-78e296796fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Flow 'volume_create_manager' (2731196e-cf13-4063-8360-a243a7397e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[08751803-5353-4d25-b4f8-6e63f358ec57]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:11 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-25e454e6-0e21-469d-afc9-787758a2bc3c tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Created volume successfully.
Apr 13 18:47:11 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61
Apr 13 18:47:11 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Flow 'volume_create_manager' (740466b7-5759-4bf0-9f63-d04b52fced7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591b5b11-468b-4b31-aee9-bfbfeb0e7ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591b5b11-468b-4b31-aee9-bfbfeb0e7ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1888871490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161abe42-f865-46a8-a7bb-fe00c95dec4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f526ad3b7ccb42d6a8378a23ecc2ffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:12Z,use_quota=True,user_id='56bdf24e6cea4dcfbafbb95d6fdee03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e025553f-8ee9-4b0b-bc0a-87a3dd1d8f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e025553f-8ee9-4b0b-bc0a-87a3dd1d8f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eb6dc6-0697-4efd-8789-f52a47236192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eb6dc6-0697-4efd-8789-f52a47236192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161abe42-f865-46a8-a7bb-fe00c95dec4d', 'volume_name': 'volume-161abe42-f865-46a8-a7bb-fe00c95dec4d', 'volume_size': 2}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf0c915-cc09-4905-a0be-93e53347d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf0c915-cc09-4905-a0be-93e53347d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787a1978-ac29-4982-82b4-d811e09388ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:12 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Volume 161abe42-f865-46a8-a7bb-fe00c95dec4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161abe42-f865-46a8-a7bb-fe00c95dec4d', 'volume_size': 2}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1888871490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161abe42-f865-46a8-a7bb-fe00c95dec4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f526ad3b7ccb42d6a8378a23ecc2ffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:12Z,use_quota=True,user_id='56bdf24e6cea4dcfbafbb95d6fdee03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Creating volume 161abe42-f865-46a8-a7bb-fe00c95dec4d {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:12 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d 2147483648 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:12 devstack sudo[88287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d 2147483648
Apr 13 18:47:12 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:12 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61" returned: 0 in 0.516s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:12 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61
Apr 13 18:47:12 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:12 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d 2147483648" returned: 0 in 0.600s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:12 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d
Apr 13 18:47:12 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:12 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-02b7bb67-b6f1-4d4f-91af-ad366200bc61" returned: 0 in 0.512s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Lock "cinder-quobyte-02b7bb67-b6f1-4d4f-91af-ad366200bc61" released by "delete_volume" :: held 1.060s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Created reservations ['72bd2900-6a9b-4f83-915d-e1f95ce11b34', 'd33f3864-7c2b-4c48-9aed-d3dac532713c', '678860c6-2842-49c9-a0e2-da3cdf9d6761', '69a87708-c104-4603-adb9-ff794835348b'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:13 devstack sudo[88306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:13 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:13 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d" returned: 0 in 0.550s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.483s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787a1978-ac29-4982-82b4-d811e09388ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161abe42-f865-46a8-a7bb-fe00c95dec4d', 'volume_size': 2}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca55413-5cc3-4570-977a-e8c1641955e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Creating offline snapshot 6d5d4c01-b71c-430a-98bc-d8dd93128af9 of volume 2071a059-ba27-4bf6-9635-884ba1edadb3 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:47:13 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Volume volume-161abe42-f865-46a8-a7bb-fe00c95dec4d (161abe42-f865-46a8-a7bb-fe00c95dec4d): created successfully
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca55413-5cc3-4570-977a-e8c1641955e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Flow 'volume_create_manager' (740466b7-5759-4bf0-9f63-d04b52fced7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[173d3f79-2daa-4edd-9113-ae3b5d8da93a]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5bb616ae-7dda-4352-8917-f54a83073bac tempest-VolumesCloneNegativeTest-1638578406 None] Created volume successfully.
Apr 13 18:47:13 devstack sudo[88309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3
Apr 13 18:47:13 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:13 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.500s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Deleted volume successfully.
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4266b9a0-5cb8-4aee-85c8-f279c01edf2c tempest-VolumesTestJSON-545421089 None] Lock "cinder-02b7bb67-b6f1-4d4f-91af-ad366200bc61-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:13 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3" returned: 0 in 0.523s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 2G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:13 devstack sudo[88316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 2G
Apr 13 18:47:13 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Acquiring lock "cinder-08559e41-3c52-49c3-be01-eb18952a4cfe-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Lock "cinder-08559e41-3c52-49c3-be01-eb18952a4cfe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Acquiring lock "cinder-quobyte-08559e41-3c52-49c3-be01-eb18952a4cfe" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Lock "cinder-quobyte-08559e41-3c52-49c3-be01-eb18952a4cfe" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31458a3-5592-472b-a502-0dda11536c7b]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:14 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe
Apr 13 18:47:14 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Acquiring lock "cinder-161abe42-f865-46a8-a7bb-fe00c95dec4d-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Lock "cinder-161abe42-f865-46a8-a7bb-fe00c95dec4d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Acquiring lock "cinder-quobyte-161abe42-f865-46a8-a7bb-fe00c95dec4d" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Lock "cinder-quobyte-161abe42-f865-46a8-a7bb-fe00c95dec4d" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6df791-3584-4cb3-9e2e-5cce958297c2]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:14 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 2G" returned: 0 in 0.569s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2071a059-ba27-4bf6-9635-884ba1edadb3 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:14 devstack sudo[88328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d
Apr 13 18:47:14 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:14 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2071a059-ba27-4bf6-9635-884ba1edadb3 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9
Apr 13 18:47:14 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:14 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe" returned: 0 in 0.592s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:14 devstack sudo[88344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe
Apr 13 18:47:14 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:14 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d" returned: 0 in 0.528s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:14 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2071a059-ba27-4bf6-9635-884ba1edadb3 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9" returned: 0 in 0.475s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:14 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 is being set with open permissions: ugo+rw
Apr 13 18:47:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:14 devstack sudo[88354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d
Apr 13 18:47:14 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:14 devstack sudo[88355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9
Apr 13 18:47:14 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:15 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-08559e41-3c52-49c3-be01-eb18952a4cfe" returned: 0 in 0.479s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Lock "cinder-quobyte-08559e41-3c52-49c3-be01-eb18952a4cfe" released by "delete_volume" :: held 1.093s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Created reservations ['9ff2e807-b957-4c09-8d86-e7cdaa9891dc', '12e6a6c0-d27e-48ab-8da0-d114c595a2bc', 'f898f26d-775c-4557-9ec4-9f9574162365', '0edb63e9-2079-468c-9334-2034d1da0487'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:15 devstack sudo[88359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:15 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:15 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-161abe42-f865-46a8-a7bb-fe00c95dec4d" returned: 0 in 0.470s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Lock "cinder-quobyte-161abe42-f865-46a8-a7bb-fe00c95dec4d" released by "delete_volume" :: held 1.019s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Created reservations ['2f75da61-e2b9-4f50-abbb-53357ab00aa4', '4fd835c7-b2b9-4428-be86-1936a85d410a', 'd1100c02-60b1-4d5f-9dcf-36a9372a0fb7', '870481de-a68b-42ea-95d2-79c26ceba1ea'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:15 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9" returned: 0 in 0.511s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:15 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.info
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:15 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:15 devstack sudo[88365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:15 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:15 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.421s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:15 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Deleted volume successfully.
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1beec601-2144-41bd-8b97-cca6d3d3811d tempest-VolumesTestJSON-545421089 None] Lock "cinder-08559e41-3c52-49c3-be01-eb18952a4cfe-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:15 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.425s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:15 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Deleted volume successfully.
Apr 13 18:47:15 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.info" returned: 0 in 0.468s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:15 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.info is being set with open permissions: ugo+rw
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c368fd41-26c5-4228-b7a5-0761db8d73d9 tempest-VolumesCloneNegativeTest-1638578406 None] Lock "cinder-161abe42-f865-46a8-a7bb-fe00c95dec4d-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:15 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.info
Apr 13 18:47:15 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:16 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.info" returned: 0 in 0.471s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.137s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:16 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-552fb218-f7df-4719-a5cd-5e902ebd0d0a tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Create snapshot completed successfully
Apr 13 18:47:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Acquiring lock "cinder-6d5d4c01-b71c-430a-98bc-d8dd93128af9-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-6d5d4c01-b71c-430a-98bc-d8dd93128af9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Acquiring lock "cinder-quobyte-2071a059-ba27-4bf6-9635-884ba1edadb3" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-quobyte-2071a059-ba27-4bf6-9635-884ba1edadb3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Acquiring lock "cinder-quobyte-6d5d4c01-b71c-430a-98bc-d8dd93128af9" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-quobyte-6d5d4c01-b71c-430a-98bc-d8dd93128af9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Deleting offline snapshot 6d5d4c01-b71c-430a-98bc-d8dd93128af9 of volume 2071a059-ba27-4bf6-9635-884ba1edadb3 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] snapshot_file for this snap is: volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc3e81d-eb20-40fc-8e74-92c30c295840]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:17 devstack sudo[88374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9
Apr 13 18:47:17 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:17 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9" returned: 0 in 0.610s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2071a059-ba27-4bf6-9635-884ba1edadb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d873e2-c919-4393-93d6-80dd62b15736]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:17 devstack sudo[88382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3
Apr 13 18:47:17 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:18 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3" returned: 0 in 0.610s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:18 devstack sudo[88387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9
Apr 13 18:47:18 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (4d41faf3-bab8-49d3-8f70-c9beacc85daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79158474-d819-4469-9aeb-00837c4d4f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79158474-d819-4469-9aeb-00837c4d4f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2039395663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5edab3-f7af-480e-9165-c5d63dca6863,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:19Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d48824-70c6-4955-8c7d-5c1df5b9b709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d48824-70c6-4955-8c7d-5c1df5b9b709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6699336d-2635-49a5-97fa-8006c28e1d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6699336d-2635-49a5-97fa-8006c28e1d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5edab3-f7af-480e-9165-c5d63dca6863', 'volume_name': 'volume-8a5edab3-f7af-480e-9165-c5d63dca6863', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a9c616-1bd8-4d7e-b6e4-7e7fcd74d713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a9c616-1bd8-4d7e-b6e4-7e7fcd74d713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b52d5a-de77-4cdc-b9e1-c37df0847c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:18 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Volume 8a5edab3-f7af-480e-9165-c5d63dca6863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5edab3-f7af-480e-9165-c5d63dca6863', 'volume_size': 1}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2039395663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5edab3-f7af-480e-9165-c5d63dca6863,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:19Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Creating volume 8a5edab3-f7af-480e-9165-c5d63dca6863 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:18 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:18 devstack sudo[88414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863 1073741824
Apr 13 18:47:18 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:19 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9" returned: 0 in 0.755s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:19 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9
Apr 13 18:47:19 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:19 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863 1073741824" returned: 0 in 0.814s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:19 devstack sudo[88428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863
Apr 13 18:47:19 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:19 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3.6d5d4c01-b71c-430a-98bc-d8dd93128af9" returned: 0 in 0.667s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-quobyte-6d5d4c01-b71c-430a-98bc-d8dd93128af9" released by "_delete_snapshot" :: held 2.759s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-quobyte-2071a059-ba27-4bf6-9635-884ba1edadb3" released by "delete_snapshot" :: held 2.775s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:19 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Created reservations ['6695cdcb-904f-4989-85c2-99f5681284c5', '1d004f5f-a33e-4e84-8f63-d6138b6eae93', 'a7cdb973-c541-4734-ab13-7e8a13fef7c4', 'f26f10a1-e633-4ba8-9f70-191e0642d8ee'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:19 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Delete snapshot completed successfully.
Apr 13 18:47:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f2eb70db-9b6a-41e6-9015-33c02cea3436 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-6d5d4c01-b71c-430a-98bc-d8dd93128af9-delete_snapshot" released by "delete_snapshot" :: held 2.954s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:20 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863" returned: 0 in 0.725s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b52d5a-de77-4cdc-b9e1-c37df0847c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5edab3-f7af-480e-9165-c5d63dca6863', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1892dfaa-8f1a-42bc-9ae9-b35375938f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Acquiring lock "cinder-2071a059-ba27-4bf6-9635-884ba1edadb3-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:20 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Volume volume-8a5edab3-f7af-480e-9165-c5d63dca6863 (8a5edab3-f7af-480e-9165-c5d63dca6863): created successfully
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1892dfaa-8f1a-42bc-9ae9-b35375938f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (4d41faf3-bab8-49d3-8f70-c9beacc85daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-be4ee434-8abb-4ffe-8c48-912523e651d9 tempest-VolumesGetTest-1270140323 None] Created volume successfully.
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-2071a059-ba27-4bf6-9635-884ba1edadb3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Acquiring lock "cinder-quobyte-2071a059-ba27-4bf6-9635-884ba1edadb3" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-quobyte-2071a059-ba27-4bf6-9635-884ba1edadb3" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5391da7-944b-4b33-8c1d-be4b865f2084]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:20 devstack sudo[88465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3
Apr 13 18:47:20 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:21 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3" returned: 0 in 0.680s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:21 devstack sudo[88473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3
Apr 13 18:47:21 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (30cbda70-2c9c-432d-bfd8-43ea9798457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a376b848-2e3c-4125-9ffe-70776cb348e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a376b848-2e3c-4125-9ffe-70776cb348e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-493931289',display_name='tempest-VolumesGetTest-Volume-1744673206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16351d82-1d96-4714-80af-b6773476630e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:21Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd50f79-60a0-43d6-ad76-615fb642f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd50f79-60a0-43d6-ad76-615fb642f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4fe1c1-e154-430f-8f21-b65f1d1fde7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4fe1c1-e154-430f-8f21-b65f1d1fde7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16351d82-1d96-4714-80af-b6773476630e', 'volume_name': 'volume-16351d82-1d96-4714-80af-b6773476630e', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde6d91a-d3cc-4a74-becf-c1422dcd343d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde6d91a-d3cc-4a74-becf-c1422dcd343d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5c427e-f0eb-4bb3-952a-aa22794950f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:21 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Volume 16351d82-1d96-4714-80af-b6773476630e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16351d82-1d96-4714-80af-b6773476630e', 'volume_size': 1}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-493931289',display_name='tempest-VolumesGetTest-Volume-1744673206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16351d82-1d96-4714-80af-b6773476630e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:21Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Creating volume 16351d82-1d96-4714-80af-b6773476630e {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:21 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:21 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e 1073741824
Apr 13 18:47:21 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e63999ce-fbaa-420c-be18-2d0374900bf8 tempest-GroupsV320Test-153768383 None] Group tempest-GroupsV320Test-Group-1537545200: creating
Apr 13 18:47:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e63999ce-fbaa-420c-be18-2d0374900bf8 tempest-GroupsV320Test-153768383 None] Group tempest-GroupsV320Test-Group-1537545200: created successfully
Apr 13 18:47:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e63999ce-fbaa-420c-be18-2d0374900bf8 tempest-GroupsV320Test-153768383 None] Create group completed successfully.
Apr 13 18:47:21 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2071a059-ba27-4bf6-9635-884ba1edadb3" returned: 0 in 0.797s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-quobyte-2071a059-ba27-4bf6-9635-884ba1edadb3" released by "delete_volume" :: held 1.513s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Created reservations ['aef7a904-d21b-4c94-9625-0a0805d124d2', 'f5b4c03c-dda1-4fb4-9c4a-6513d3706a5c', '47a6937c-6c20-4321-974e-268975fdd256', '47eb2400-83d1-4f12-9697-c0ed5b7ef718'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:22 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e 1073741824" returned: 0 in 0.703s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:22 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:22 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:22 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e
Apr 13 18:47:22 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:22 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.446s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Deleted volume successfully.
Apr 13 18:47:22 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e" returned: 0 in 0.425s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fe3d1885-bb12-4596-b9e2-9e4402bd2c76 tempest-VolumesSnapshotNegativeTestJSON-614255388 None] Lock "cinder-2071a059-ba27-4bf6-9635-884ba1edadb3-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5c427e-f0eb-4bb3-952a-aa22794950f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16351d82-1d96-4714-80af-b6773476630e', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f85026-ea76-4e71-9538-93d004c41955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:22 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Volume volume-16351d82-1d96-4714-80af-b6773476630e (16351d82-1d96-4714-80af-b6773476630e): created successfully
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f85026-ea76-4e71-9538-93d004c41955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (30cbda70-2c9c-432d-bfd8-43ea9798457e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9c29418c-4eae-4942-9dc1-30a73eb11881 tempest-VolumesGetTest-1270140323 None] Created volume successfully.
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] Created reservations ['02702a28-6be1-46a3-9349-35d6533a1396'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:23 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:23 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-16351d82-1d96-4714-80af-b6773476630e-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Lock "cinder-16351d82-1d96-4714-80af-b6773476630e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-quobyte-16351d82-1d96-4714-80af-b6773476630e" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-16351d82-1d96-4714-80af-b6773476630e" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6883414-f070-4715-9bf6-0dae68293140]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:23 devstack sudo[88517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e
Apr 13 18:47:23 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:23 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:23 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b42dabe1-dd83-465f-b6d2-73b12c8693bc tempest-GroupsV320Test-153768383 None] Delete group completed successfully.
Apr 13 18:47:24 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e" returned: 0 in 0.518s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:24 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e
Apr 13 18:47:24 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (179a0c55-0a59-468e-a1fa-b75a89c67453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8187af91-5b02-4e4d-8425-d47673df6f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8187af91-5b02-4e4d-8425-d47673df6f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1750406912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7237b6-8c72-419c-8f9d-85f6b179b93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:24Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e72827-ed10-470e-b016-8961f282c2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e72827-ed10-470e-b016-8961f282c2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b79411-b79a-4bef-a5dc-93739dc22d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b79411-b79a-4bef-a5dc-93739dc22d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a7237b6-8c72-419c-8f9d-85f6b179b93d', 'volume_name': 'volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61061101-dc5f-4eff-afb0-4912d3dbc479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61061101-dc5f-4eff-afb0-4912d3dbc479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d946a3f-4a0d-412c-84c6-d64e0439113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:24 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume 1a7237b6-8c72-419c-8f9d-85f6b179b93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d', 'volume_size': 1}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1750406912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7237b6-8c72-419c-8f9d-85f6b179b93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:24Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Creating volume 1a7237b6-8c72-419c-8f9d-85f6b179b93d {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:24 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:24 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-16351d82-1d96-4714-80af-b6773476630e" returned: 0 in 0.499s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:24 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d 1073741824
Apr 13 18:47:24 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-16351d82-1d96-4714-80af-b6773476630e" released by "delete_volume" :: held 1.039s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Created reservations ['eb9a24c0-61d6-4477-b9dc-df0e1056b1ec', '6abc3072-aa48-4954-a982-b0610240a1b0', 'd22e701d-f21a-47b9-b5d1-f3f63e1f0bc7', '7b20362d-8a1a-4cfe-b2c6-c4d21a705a39'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:24 devstack sudo[88530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:24 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:25 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d 1073741824" returned: 0 in 0.501s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:25 devstack sudo[88536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d
Apr 13 18:47:25 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:25 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.483s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:25 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Deleted volume successfully.
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-44cfdbd3-c944-4bb6-8984-a722d2779201 tempest-VolumesGetTest-1270140323 None] Lock "cinder-16351d82-1d96-4714-80af-b6773476630e-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:25 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d" returned: 0 in 0.471s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d946a3f-4a0d-412c-84c6-d64e0439113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c79a8a-4465-4574-8f54-547fad32b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:25 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d (1a7237b6-8c72-419c-8f9d-85f6b179b93d): created successfully
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c79a8a-4465-4574-8f54-547fad32b714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (179a0c55-0a59-468e-a1fa-b75a89c67453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:25 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-47b70c67-564c-43be-b44a-4cc85f75e0e8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created volume successfully.
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-8a5edab3-f7af-480e-9165-c5d63dca6863-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Lock "cinder-8a5edab3-f7af-480e-9165-c5d63dca6863-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-quobyte-8a5edab3-f7af-480e-9165-c5d63dca6863" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-8a5edab3-f7af-480e-9165-c5d63dca6863" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d5ed32-6479-46f2-9b20-37c215ee70b3]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:25 devstack sudo[88539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863
Apr 13 18:47:25 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:26 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863" returned: 0 in 0.511s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:26 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863
Apr 13 18:47:26 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Creating offline snapshot 26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 of volume 1a7237b6-8c72-419c-8f9d-85f6b179b93d {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2098d40b-a6b3-453f-b6fa-80cf572b1ab4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:26 devstack sudo[88547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d
Apr 13 18:47:26 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:26 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-8a5edab3-f7af-480e-9165-c5d63dca6863" returned: 0 in 0.551s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-8a5edab3-f7af-480e-9165-c5d63dca6863" released by "delete_volume" :: held 1.088s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Created reservations ['a703e9b7-fa15-4080-b8c8-5948b251952a', 'd941dc10-8898-42ba-a406-a447114d16af', 'bb7efcfe-51d4-4c20-a8fc-88c7bf21593b', '5db6c4ac-a6bd-4385-8d51-c992de248224'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:27 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:27 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:27 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d" returned: 0 in 0.603s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:27 devstack sudo[88555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 1G
Apr 13 18:47:27 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:27 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.445s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:27 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Deleted volume successfully.
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c5b8cacb-d4cb-41f3-8a17-eb3c3a2ed322 tempest-VolumesGetTest-1270140323 None] Lock "cinder-8a5edab3-f7af-480e-9165-c5d63dca6863-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Flow 'volume_create_manager' (5274fc10-e1d2-4f3d-b26d-aacc73a8b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040dd576-fd38-4c4c-92a2-b6d844e58000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040dd576-fd38-4c4c-92a2-b6d844e58000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-934525516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bce2a15-21c0-4231-bd35-78d267201fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0f533b23e48568d79dc77777a421d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:28Z,use_quota=True,user_id='94d0af41adfd4c638a12f8d8c35f7582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e4f6f0-9b82-4925-a76b-454ca4f6307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e4f6f0-9b82-4925-a76b-454ca4f6307d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61295094-ea4a-4039-8ed1-6f2c69b1b699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61295094-ea4a-4039-8ed1-6f2c69b1b699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bce2a15-21c0-4231-bd35-78d267201fe7', 'volume_name': 'volume-6bce2a15-21c0-4231-bd35-78d267201fe7', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefab161-1e2d-4147-836c-92fd82c11d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefab161-1e2d-4147-836c-92fd82c11d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf01f3a-b251-43fc-8309-bb977b9bc5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:27 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Volume 6bce2a15-21c0-4231-bd35-78d267201fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bce2a15-21c0-4231-bd35-78d267201fe7', 'volume_size': 1}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:27 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 1G" returned: 0 in 0.566s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:27 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9
Apr 13 18:47:27 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (b6ca4e5c-c058-4576-87cf-28bd8fe8ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e674b9a-8eab-4f78-a104-4fcd8a053e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e674b9a-8eab-4f78-a104-4fcd8a053e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-535996933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bd6503-ecf2-4f80-a267-1f400b170dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:28Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c49e0d-5033-4616-966a-1e50ac282f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c49e0d-5033-4616-966a-1e50ac282f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad857935-dc7f-4e8d-bc80-4c06f3f66566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad857935-dc7f-4e8d-bc80-4c06f3f66566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bd6503-ecf2-4f80-a267-1f400b170dad', 'volume_name': 'volume-96bd6503-ecf2-4f80-a267-1f400b170dad', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8a176e-2caa-4146-a9de-3f9e0ec03c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8a176e-2caa-4146-a9de-3f9e0ec03c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7564c7-d74c-4933-9d74-6c150060d1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:28 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Volume 96bd6503-ecf2-4f80-a267-1f400b170dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bd6503-ecf2-4f80-a267-1f400b170dad', 'volume_size': 1}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:28 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9" returned: 0 in 0.470s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:28 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 is being set with open permissions: ugo+rw
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:28 devstack sudo[88565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9
Apr 13 18:47:28 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:28 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9" returned: 0 in 0.449s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:28 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.info
Apr 13 18:47:28 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:29 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.info" returned: 0 in 0.473s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:29 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.info is being set with open permissions: ugo+rw
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:29 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.info
Apr 13 18:47:29 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:29 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.info" returned: 0 in 0.412s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.032s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-934525516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bce2a15-21c0-4231-bd35-78d267201fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe0f533b23e48568d79dc77777a421d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:28Z,use_quota=True,user_id='94d0af41adfd4c638a12f8d8c35f7582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Creating volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:29 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:29 devstack sudo[88576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7 1073741824
Apr 13 18:47:29 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:29 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-7faa1332-5acd-47bb-b106-5c9c9c6074d6 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Create snapshot completed successfully
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (d156b581-4e94-4fcc-bc0c-394c9842cb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd34cf25-cbae-4776-a34c-a7589d2c6377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd34cf25-cbae-4776-a34c-a7589d2c6377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1272566834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae2a42d-26ec-4fe7-b1fa-32363ca031b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:30Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a04c4a1-ecff-470e-8db5-2fa13b7d7c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a04c4a1-ecff-470e-8db5-2fa13b7d7c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab82b5ba-0340-4325-9670-260692518668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab82b5ba-0340-4325-9670-260692518668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae2a42d-26ec-4fe7-b1fa-32363ca031b9', 'volume_name': 'volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c78914-3bad-4666-a0cd-9975f1b01d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c78914-3bad-4666-a0cd-9975f1b01d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637c8a63-712d-4d62-ba11-0fffe9a85fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume aae2a42d-26ec-4fe7-b1fa-32363ca031b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9', 'volume_size': 1}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (e24a0099-141e-49c1-85a1-6995e3cc73bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90409ab7-7396-4380-b73e-202ab9ac4c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90409ab7-7396-4380-b73e-202ab9ac4c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-586252412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5660342c-db0f-4559-b518-7798729f7f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:30Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2058806-de6e-42ea-8417-360d2aec5c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2058806-de6e-42ea-8417-360d2aec5c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c9c8ea-20ab-4d0f-8167-37e1647205f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c9c8ea-20ab-4d0f-8167-37e1647205f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5660342c-db0f-4559-b518-7798729f7f41', 'volume_name': 'volume-5660342c-db0f-4559-b518-7798729f7f41', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86734e5d-d6fd-43da-a17c-3dbb00c753b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86734e5d-d6fd-43da-a17c-3dbb00c753b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc93ffce-e5dd-4247-b027-718a9a2594af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume 5660342c-db0f-4559-b518-7798729f7f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5660342c-db0f-4559-b518-7798729f7f41', 'volume_size': 1}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7 1073741824" returned: 0 in 0.639s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:30 devstack sudo[88581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7
Apr 13 18:47:30 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (dc4c1622-1511-434c-be0e-83708a20c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54233d8-a305-4aed-8c23-9deab27216d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54233d8-a305-4aed-8c23-9deab27216d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1752188751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badd7a91-833a-4686-b4b0-51b1eb721d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:31Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d3f7ee-7fe5-4d3c-affd-acb6fe6df288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d3f7ee-7fe5-4d3c-affd-acb6fe6df288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f6c0c8-0991-43ee-91ff-b728cf47f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f6c0c8-0991-43ee-91ff-b728cf47f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'badd7a91-833a-4686-b4b0-51b1eb721d4f', 'volume_name': 'volume-badd7a91-833a-4686-b4b0-51b1eb721d4f', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c650f8a-56b7-4044-98b4-ed1277b4ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c650f8a-56b7-4044-98b4-ed1277b4ce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6ca8c7-5ef1-498b-a213-8d01788e06f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume badd7a91-833a-4686-b4b0-51b1eb721d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-badd7a91-833a-4686-b4b0-51b1eb721d4f', 'volume_size': 1}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (4e0142a1-7ea0-424b-9455-5e761944815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfebe1f-176f-4dd4-a92a-dfb2dce267ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfebe1f-176f-4dd4-a92a-dfb2dce267ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2074942755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38e4db2-f8ab-4201-9d62-61962d0b2701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:31Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78117104-657a-454d-92e6-65a8351a86b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78117104-657a-454d-92e6-65a8351a86b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475de935-afa1-4b5a-b791-af7a9609125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475de935-afa1-4b5a-b791-af7a9609125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38e4db2-f8ab-4201-9d62-61962d0b2701', 'volume_name': 'volume-a38e4db2-f8ab-4201-9d62-61962d0b2701', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39a51cc-c22e-4673-a6bb-db75e0cd5ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39a51cc-c22e-4673-a6bb-db75e0cd5ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a19cd9-9fa3-460a-b71d-1e8e2fc7709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume a38e4db2-f8ab-4201-9d62-61962d0b2701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38e4db2-f8ab-4201-9d62-61962d0b2701', 'volume_size': 1}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:30 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7" returned: 0 in 0.517s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.712s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-535996933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bd6503-ecf2-4f80-a267-1f400b170dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:28Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Creating volume 96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:30 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf01f3a-b251-43fc-8309-bb977b9bc5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bce2a15-21c0-4231-bd35-78d267201fe7', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6cfce2-68fb-4f70-91ca-2af5afb4c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:31 devstack sudo[88584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad 1073741824
Apr 13 18:47:31 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:31 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Volume volume-6bce2a15-21c0-4231-bd35-78d267201fe7 (6bce2a15-21c0-4231-bd35-78d267201fe7): created successfully
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6cfce2-68fb-4f70-91ca-2af5afb4c628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Flow 'volume_create_manager' (5274fc10-e1d2-4f3d-b26d-aacc73a8b955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:31 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-586366f2-740f-447d-bf7d-664d313cecf4 tempest-SnapshotsActionsTest-1928959964 None] Created volume successfully.
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (45ade379-ed3b-4456-8f15-d2aee78f6ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4a845b-6c68-4471-8f0e-4922dae4a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4a845b-6c68-4471-8f0e-4922dae4a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754072635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2ae3d2-f5fc-455a-9c65-b60b910ef106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:31Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d36a2aa-6f4c-4f9f-a5eb-2d2e0c9328b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d36a2aa-6f4c-4f9f-a5eb-2d2e0c9328b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcce57c5-fab5-4c51-b3d4-f599dad2ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcce57c5-fab5-4c51-b3d4-f599dad2ad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2ae3d2-f5fc-455a-9c65-b60b910ef106', 'volume_name': 'volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8730ac90-172d-41b1-a815-7e30341f8b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8730ac90-172d-41b1-a815-7e30341f8b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0434773-3c84-4f0b-a96a-7aa8817da82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:31 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume 6f2ae3d2-f5fc-455a-9c65-b60b910ef106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106', 'volume_size': 1}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:31 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad 1073741824" returned: 0 in 0.613s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:31 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad
Apr 13 18:47:31 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Acquiring lock "cinder-e48f5dfb-3670-4abb-bf73-b93770f93c2c-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Lock "cinder-e48f5dfb-3670-4abb-bf73-b93770f93c2c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Acquiring lock "cinder-quobyte-e48f5dfb-3670-4abb-bf73-b93770f93c2c" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Lock "cinder-quobyte-e48f5dfb-3670-4abb-bf73-b93770f93c2c" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ecbf80-47cd-4a5d-b7b4-3e8a11d10227]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:31 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c
Apr 13 18:47:31 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:32 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad" returned: 0 in 0.484s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.886s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1272566834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae2a42d-26ec-4fe7-b1fa-32363ca031b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:30Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Creating volume aae2a42d-26ec-4fe7-b1fa-32363ca031b9 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:32 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7564c7-d74c-4933-9d74-6c150060d1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bd6503-ecf2-4f80-a267-1f400b170dad', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3671f4d9-7b97-4579-8a08-678a72cbe2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:32 devstack sudo[88594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9 1073741824
Apr 13 18:47:32 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:32 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Volume volume-96bd6503-ecf2-4f80-a267-1f400b170dad (96bd6503-ecf2-4f80-a267-1f400b170dad): created successfully
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3671f4d9-7b97-4579-8a08-678a72cbe2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (b6ca4e5c-c058-4576-87cf-28bd8fe8ef46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:32 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c010e387-6492-49bc-a6e0-f7d248e501e4 tempest-VolumesGetTest-1270140323 None] Created volume successfully.
Apr 13 18:47:32 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c" returned: 0 in 0.521s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:32 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c
Apr 13 18:47:32 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (74e5c7a6-1a84-4ee6-bf9f-1dc9129f232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec805177-b0a4-47df-8c12-61ec09869995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:32 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9 1073741824" returned: 0 in 0.535s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec805177-b0a4-47df-8c12-61ec09869995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1474581287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8019ad-93c3-447c-b106-8db1eaa9a9f4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=96bd6503-ecf2-4f80-a267-1f400b170dad,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:33Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cd39e4-2b16-436e-87c6-5f774509b8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cd39e4-2b16-436e-87c6-5f774509b8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff34433-ccfe-494c-abc1-87c5986e7eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff34433-ccfe-494c-abc1-87c5986e7eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ae8019ad-93c3-447c-b106-8db1eaa9a9f4', 'volume_name': 'volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4', 'volume_size': 1, 'source_volid': '96bd6503-ecf2-4f80-a267-1f400b170dad', 'source_volstatus': 'available'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d86c32-2c16-46d3-8e4d-08262834ed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d86c32-2c16-46d3-8e4d-08262834ed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409f1ba5-4fd8-43b9-b5c3-33b5aa7e84ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:32 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Volume ae8019ad-93c3-447c-b106-8db1eaa9a9f4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4', 'volume_size': 1, 'source_volid': '96bd6503-ecf2-4f80-a267-1f400b170dad', 'source_volstatus': 'available'}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:32 devstack sudo[88604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9
Apr 13 18:47:32 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:32 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e48f5dfb-3670-4abb-bf73-b93770f93c2c" returned: 0 in 0.485s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Lock "cinder-quobyte-e48f5dfb-3670-4abb-bf73-b93770f93c2c" released by "delete_volume" :: held 1.025s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Created reservations ['eb5f9d6a-30bc-41cb-a818-88582aca6304', '3de59d83-79e7-4379-bb2b-ef1267ab882a', 'b1fa05e4-ec65-4ea4-9e79-3793c29455d5', 'd5fa5741-6969-48ea-9490-e123d0246484'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:32 devstack sudo[88607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:32 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:33 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9" returned: 0 in 0.422s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.719s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-586252412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5660342c-db0f-4559-b518-7798729f7f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:30Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Creating volume 5660342c-db0f-4559-b518-7798729f7f41 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:33 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637c8a63-712d-4d62-ba11-0fffe9a85fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b74b38-dfba-465a-8d76-e73635446561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:33 devstack sudo[88610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41 1073741824
Apr 13 18:47:33 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:33 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9 (aae2a42d-26ec-4fe7-b1fa-32363ca031b9): created successfully
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b74b38-dfba-465a-8d76-e73635446561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (d156b581-4e94-4fcc-bc0c-394c9842cb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:33 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-0f7a9bf3-c59f-485b-aa36-60d54991fe04 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created volume successfully.
Apr 13 18:47:33 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.441s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:33 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Deleted volume successfully.
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b1691a97-6fef-4fd3-8ae1-93f731aa07e9 tempest-VolumesNegativeTest-345687444 None] Lock "cinder-e48f5dfb-3670-4abb-bf73-b93770f93c2c-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:33 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41 1073741824" returned: 0 in 0.499s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:33 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41
Apr 13 18:47:33 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:34 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41" returned: 0 in 0.407s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.395s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1752188751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badd7a91-833a-4686-b4b0-51b1eb721d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:31Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Creating volume badd7a91-833a-4686-b4b0-51b1eb721d4f {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:34 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc93ffce-e5dd-4247-b027-718a9a2594af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5660342c-db0f-4559-b518-7798729f7f41', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b826847-8264-4d8e-b5a4-f3b297aaa64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:34 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f 1073741824
Apr 13 18:47:34 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:34 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume volume-5660342c-db0f-4559-b518-7798729f7f41 (5660342c-db0f-4559-b518-7798729f7f41): created successfully
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b826847-8264-4d8e-b5a4-f3b297aaa64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (e24a0099-141e-49c1-85a1-6995e3cc73bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:34 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-568d4944-8bdb-4cd3-896f-78335c7df98c tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created volume successfully.
Apr 13 18:47:34 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f 1073741824" returned: 0 in 0.547s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:34 devstack sudo[88625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f
Apr 13 18:47:34 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:35 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f" returned: 0 in 0.401s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.156s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2074942755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38e4db2-f8ab-4201-9d62-61962d0b2701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:31Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Creating volume a38e4db2-f8ab-4201-9d62-61962d0b2701 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:35 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6ca8c7-5ef1-498b-a213-8d01788e06f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-badd7a91-833a-4686-b4b0-51b1eb721d4f', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60da3f24-1bac-43d1-8bdc-185e26d69efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:35 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701 1073741824
Apr 13 18:47:35 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:35 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume volume-badd7a91-833a-4686-b4b0-51b1eb721d4f (badd7a91-833a-4686-b4b0-51b1eb721d4f): created successfully
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60da3f24-1bac-43d1-8bdc-185e26d69efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (dc4c1622-1511-434c-be0e-83708a20c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:35 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d4454b90-1b6b-42f2-8d2b-1bde08f7189f tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created volume successfully.
Apr 13 18:47:35 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701 1073741824" returned: 0 in 0.543s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:35 devstack sudo[88633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701
Apr 13 18:47:35 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:36 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701" returned: 0 in 0.472s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.931s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754072635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2ae3d2-f5fc-455a-9c65-b60b910ef106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94871af7e28c4ff78ae203401f2db986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:31Z,use_quota=True,user_id='103faed7737a4ee29822bf3f4c56eab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Creating volume 6f2ae3d2-f5fc-455a-9c65-b60b910ef106 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:36 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a19cd9-9fa3-460a-b71d-1e8e2fc7709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38e4db2-f8ab-4201-9d62-61962d0b2701', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e8b04f-b87b-4de4-a3ca-b068465f1ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:36 devstack sudo[88636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106 1073741824
Apr 13 18:47:36 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:36 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume volume-a38e4db2-f8ab-4201-9d62-61962d0b2701 (a38e4db2-f8ab-4201-9d62-61962d0b2701): created successfully
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e8b04f-b87b-4de4-a3ca-b068465f1ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (4e0142a1-7ea0-424b-9455-5e761944815f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:36 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-843c29cf-e8e7-4c07-91a8-010822387d28 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created volume successfully.
Apr 13 18:47:36 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106 1073741824" returned: 0 in 0.531s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:36 devstack sudo[88641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106
Apr 13 18:47:36 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:37 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106" returned: 0 in 0.426s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.946s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0434773-3c84-4f0b-a96a-7aa8817da82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41efe940-ffad-4ab9-9f72-6d93ba551181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:37 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Volume volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106 (6f2ae3d2-f5fc-455a-9c65-b60b910ef106): created successfully
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41efe940-ffad-4ab9-9f72-6d93ba551181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Flow 'volume_create_manager' (45ade379-ed3b-4456-8f15-d2aee78f6ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Creating offline snapshot 5f50cb93-80c0-43e9-b488-884c8e528f1e of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:47:37 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ed3ad099-8f09-49d5-9ace-79e1ee60fb9e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created volume successfully.
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[da74050d-0e3e-4a9f-aaa1-99bb47432044]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:37 devstack sudo[88644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7
Apr 13 18:47:37 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-6f2ae3d2-f5fc-455a-9c65-b60b910ef106-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-6f2ae3d2-f5fc-455a-9c65-b60b910ef106-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-quobyte-6f2ae3d2-f5fc-455a-9c65-b60b910ef106" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-6f2ae3d2-f5fc-455a-9c65-b60b910ef106" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa1b442-02de-4b66-8149-706a43bd8990]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:37 devstack sudo[88649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106
Apr 13 18:47:37 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:37 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7" returned: 0 in 0.553s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:37 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e 1G
Apr 13 18:47:37 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:38 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106" returned: 0 in 0.585s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:38 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106
Apr 13 18:47:38 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:38 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e 1G" returned: 0 in 0.547s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:38 devstack sudo[88661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:47:38 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:38 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f2ae3d2-f5fc-455a-9c65-b60b910ef106" returned: 0 in 0.518s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-6f2ae3d2-f5fc-455a-9c65-b60b910ef106" released by "delete_volume" :: held 1.127s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:38 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.517s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:38 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e is being set with open permissions: ugo+rw
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created reservations ['2d548b4c-5e0d-423e-854f-9cd1352a57f0', '90e6f598-7e76-424b-b83c-a38022a038c5', 'a2df8476-be94-4c20-a5e5-990f73a8e0cd', '69620817-fd88-46c2-a2cb-e053d14b493d'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:38 devstack sudo[88667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:47:38 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:38 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:38 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:39 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.457s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:39 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.info
Apr 13 18:47:39 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:39 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.509s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:39 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Deleted volume successfully.
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-42081cb7-56a0-4d6f-8603-83ddddbf6648 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-6f2ae3d2-f5fc-455a-9c65-b60b910ef106-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:39 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-a38e4db2-f8ab-4201-9d62-61962d0b2701-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.info" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:39 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.info is being set with open permissions: ugo+rw
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:39 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.info
Apr 13 18:47:39 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-a38e4db2-f8ab-4201-9d62-61962d0b2701-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-quobyte-a38e4db2-f8ab-4201-9d62-61962d0b2701" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-a38e4db2-f8ab-4201-9d62-61962d0b2701" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc75132-4850-48e9-a6a8-5792079e083a]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:39 devstack sudo[88678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701
Apr 13 18:47:39 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:40 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.info" returned: 0 in 0.541s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.186s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.578s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:40 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Cloning volume 96bd6503-ecf2-4f80-a267-1f400b170dad to volume ae8019ad-93c3-447c-b106-8db1eaa9a9f4
Apr 13 18:47:40 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-618348d7-9d52-4069-9994-517d4cfe4ef6 tempest-SnapshotsActionsTest-1928959964 None] Create snapshot completed successfully
Apr 13 18:47:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Creating offline snapshot 265def25-a387-4c4e-a282-00858fa0b671 of volume 96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:47:40 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[31deb0ef-c838-41ab-9cd7-8128e67f5e03]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:40 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701" returned: 0 in 0.628s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:40 devstack sudo[88685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701
Apr 13 18:47:40 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad
Apr 13 18:47:40 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:40 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:41 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a38e4db2-f8ab-4201-9d62-61962d0b2701" returned: 0 in 0.538s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-a38e4db2-f8ab-4201-9d62-61962d0b2701" released by "delete_volume" :: held 1.189s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created reservations ['122b67f9-38ee-4fe6-87a4-54b00b12d3b3', '43cc1aaf-0c9d-4983-a432-8559f1fc8f13', '5c54c252-ee05-4eff-868c-c7fb2eb0116c', 'abd12658-7d10-4c6d-8c55-6bd733e506b0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:41 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad" returned: 0 in 0.679s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:41 devstack sudo[88692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:41 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:41 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 1G
Apr 13 18:47:41 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:41 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.500s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:41 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Deleted volume successfully.
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-49c36420-e6c0-42a1-8dc4-a0cece8fcc83 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-a38e4db2-f8ab-4201-9d62-61962d0b2701-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:41 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 1G" returned: 0 in 0.564s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bd6503-ecf2-4f80-a267-1f400b170dad -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:41 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bd6503-ecf2-4f80-a267-1f400b170dad -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671
Apr 13 18:47:41 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-badd7a91-833a-4686-b4b0-51b1eb721d4f-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-badd7a91-833a-4686-b4b0-51b1eb721d4f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-quobyte-badd7a91-833a-4686-b4b0-51b1eb721d4f" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-badd7a91-833a-4686-b4b0-51b1eb721d4f" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[59432b54-1746-41ba-ab48-bb8b2db0f344]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:42 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f
Apr 13 18:47:42 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:42 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96bd6503-ecf2-4f80-a267-1f400b170dad -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671" returned: 0 in 0.529s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:42 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 is being set with open permissions: ugo+rw
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:42 devstack sudo[88707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671
Apr 13 18:47:42 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:42 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f" returned: 0 in 0.635s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:42 devstack sudo[88713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f
Apr 13 18:47:42 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:42 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671" returned: 0 in 0.557s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:42 devstack sudo[88715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.info
Apr 13 18:47:42 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:42 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (ac8817c9-d0f6-4a22-977d-ab91069f730e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e22c96-5475-4a91-be9e-5c2ba459fe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e22c96-5475-4a91-be9e-5c2ba459fe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-701164334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e7e570-3050-4720-8f49-11ed4cb89120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d489c827e5848caaa857053cb1e30f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:43Z,use_quota=True,user_id='6508e4f2868845cda48a57cab44edc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b248ff2-b389-426e-9baf-e6e74bf274f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b248ff2-b389-426e-9baf-e6e74bf274f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6353422c-a4c0-48a6-b2d0-412733508aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6353422c-a4c0-48a6-b2d0-412733508aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e7e570-3050-4720-8f49-11ed4cb89120', 'volume_name': 'volume-f4e7e570-3050-4720-8f49-11ed4cb89120', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b9d8ea-eb5e-46cc-b7ff-4cb9a7c282eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b9d8ea-eb5e-46cc-b7ff-4cb9a7c282eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f257aa7-d02f-4ff1-8789-a4150b5c6d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:43 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume f4e7e570-3050-4720-8f49-11ed4cb89120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e7e570-3050-4720-8f49-11ed4cb89120', 'volume_size': 1}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:43 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-badd7a91-833a-4686-b4b0-51b1eb721d4f" returned: 0 in 0.443s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-badd7a91-833a-4686-b4b0-51b1eb721d4f" released by "delete_volume" :: held 1.099s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created reservations ['3b177ff1-f555-4830-8613-b1f3035810ef', '4f97ba4c-b974-4f8a-919c-e9ee376c50a2', '7b850035-f4a2-4e2e-871f-a2231bb11215', '6703715e-c56e-4758-99dd-d5f8bad08b50'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:43 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:43 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:43 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.info" returned: 0 in 0.473s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:43 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.info is being set with open permissions: ugo+rw
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:43 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.info
Apr 13 18:47:43 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:43 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.397s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:43 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Deleted volume successfully.
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cff832b3-5080-4519-931e-da10335928d8 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-badd7a91-833a-4686-b4b0-51b1eb721d4f-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:43 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.info" returned: 0 in 0.409s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-quobyte-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] snapshot: 265def25-a387-4c4e-a282-00858fa0b671, volume: ae8019ad-93c3-447c-b106-8db1eaa9a9f4,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[257923ee-b1f2-4701-bec3-100994a75978]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:43 devstack sudo[88726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671
Apr 13 18:47:43 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:44 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671" returned: 0 in 0.479s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bd6503-ecf2-4f80-a267-1f400b170dad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a218ea7-c691-4699-b89a-c669593b6e33]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-5660342c-db0f-4559-b518-7798729f7f41-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-5660342c-db0f-4559-b518-7798729f7f41-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-quobyte-5660342c-db0f-4559-b518-7798729f7f41" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-5660342c-db0f-4559-b518-7798729f7f41" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b979aaf-4cd2-4df9-9ba6-a731e34c56b1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:44 devstack sudo[88731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad
Apr 13 18:47:44 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:44 devstack sudo[88732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41
Apr 13 18:47:44 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:44 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad" returned: 0 in 0.489s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4 not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:44 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4
Apr 13 18:47:44 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:44 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41" returned: 0 in 0.482s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:44 devstack sudo[88743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41
Apr 13 18:47:44 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:45 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5660342c-db0f-4559-b518-7798729f7f41" returned: 0 in 0.519s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-5660342c-db0f-4559-b518-7798729f7f41" released by "delete_volume" :: held 1.032s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:45 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created reservations ['b490019c-da3d-4d36-8e29-022a8b3ff1ad', 'aab21e8e-41b7-4973-8fbe-32bdb6bbf23b', '280ee13d-0a8c-48b1-aa15-7fc7502eb3d0', 'f98b5d48-79d6-4df7-8e3f-35643f9339a8'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:45 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:45 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-aae2a42d-26ec-4fe7-b1fa-32363ca031b9-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-aae2a42d-26ec-4fe7-b1fa-32363ca031b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-quobyte-aae2a42d-26ec-4fe7-b1fa-32363ca031b9" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-aae2a42d-26ec-4fe7-b1fa-32363ca031b9" acquired by "delete_volume" :: waited 0.027s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d172fd48-75e5-4e02-95cb-5843ec67a67f]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:46 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9
Apr 13 18:47:46 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:46 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 1.238s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:46 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Deleted volume successfully.
Apr 13 18:47:46 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" returned: 0 in 2.077s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-98aefac8-75d3-460e-a05a-825052a0d784 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-5660342c-db0f-4559-b518-7798729f7f41-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16a2d87-c254-44cc-afa0-bd657afa5b12]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:46 devstack sudo[88761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad
Apr 13 18:47:46 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:47 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9" returned: 0 in 0.470s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:47 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9
Apr 13 18:47:47 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:47 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad" returned: 0 in 0.610s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4 {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:47:47 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Converted 1024.00 MB image at 492.73 MB/s
Apr 13 18:47:47 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4 is being set with open permissions: ugo+rw
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:47 devstack sudo[88771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4
Apr 13 18:47:47 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:47 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-aae2a42d-26ec-4fe7-b1fa-32363ca031b9" returned: 0 in 0.438s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-aae2a42d-26ec-4fe7-b1fa-32363ca031b9" released by "delete_volume" :: held 0.948s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created reservations ['8dce87c5-7b73-440c-ac8f-e37cddf01d2d', '4078844f-8500-4385-bf3c-c049ce71d795', 'e6970661-e90b-4abd-a7b0-bdd8b3052b39', 'f5c16249-8da6-47db-967c-e798b62e3e6c'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:47 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:47 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-26710c85-2ac0-4f8e-9a28-2515a6ac2fb9-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-26710c85-2ac0-4f8e-9a28-2515a6ac2fb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-quobyte-1a7237b6-8c72-419c-8f9d-85f6b179b93d" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-1a7237b6-8c72-419c-8f9d-85f6b179b93d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-quobyte-26710c85-2ac0-4f8e-9a28-2515a6ac2fb9" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-26710c85-2ac0-4f8e-9a28-2515a6ac2fb9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Deleting offline snapshot 26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 of volume 1a7237b6-8c72-419c-8f9d-85f6b179b93d {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] snapshot_file for this snap is: volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8ae924-7e8d-4f6b-ae22-931ae3d3e5f8]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:47 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" returned: 0 in 0.445s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" released by "_copy_volume_from_snapshot" :: held 4.149s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-quobyte-265def25-a387-4c4e-a282-00858fa0b671" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-265def25-a387-4c4e-a282-00858fa0b671" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Deleting offline snapshot 265def25-a387-4c4e-a282-00858fa0b671 of volume 96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] snapshot_file for this snap is: volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44e0342-713d-445f-bdea-254b089205e9]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:47 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9
Apr 13 18:47:47 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:47 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671
Apr 13 18:47:47 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:48 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.425s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:48 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Deleted volume successfully.
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-966e0ca2-f173-4a93-8a67-dfd06a5309c1 tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-aae2a42d-26ec-4fe7-b1fa-32363ca031b9-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:48 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c8843-4bbf-42db-b4a9-377e839d3305]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:48 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671" returned: 0 in 0.489s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96bd6503-ecf2-4f80-a267-1f400b170dad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab4ff00-d55d-4029-8c00-5dab6c5f2a39]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:48 devstack sudo[88790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d
Apr 13 18:47:48 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:48 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad
Apr 13 18:47:48 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:48 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d" returned: 0 in 0.488s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:48 devstack sudo[88800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9
Apr 13 18:47:48 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:48 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad" returned: 0 in 0.486s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:48 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671
Apr 13 18:47:48 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:49 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9" returned: 0 in 0.448s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:49 devstack sudo[88810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9
Apr 13 18:47:49 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:49 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671" returned: 0 in 0.461s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:49 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671
Apr 13 18:47:49 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:49 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d.26710c85-2ac0-4f8e-9a28-2515a6ac2fb9" returned: 0 in 0.417s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-26710c85-2ac0-4f8e-9a28-2515a6ac2fb9" released by "_delete_snapshot" :: held 1.903s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-1a7237b6-8c72-419c-8f9d-85f6b179b93d" released by "delete_snapshot" :: held 1.915s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created reservations ['07fdfe0c-1722-43ca-9ddd-d5492bbb706a', '5a76462d-3dbc-45cd-9622-3922633f5fd5', 'd46aa2b3-2c18-4e0d-b0be-e5a87fce5f3d', 'e027a719-8aa6-48ff-83f6-10b3ef929955'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:49 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad.265def25-a387-4c4e-a282-00858fa0b671" returned: 0 in 0.425s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-265def25-a387-4c4e-a282-00858fa0b671" released by "_delete_snapshot" :: held 1.907s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.427s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.817s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409f1ba5-4fd8-43b9-b5c3-33b5aa7e84ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4', 'volume_size': 1, 'source_volid': '96bd6503-ecf2-4f80-a267-1f400b170dad', 'source_volstatus': 'available'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faf0eb2-7c8b-403b-b7b7-dcf55a525334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Delete snapshot completed successfully.
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Creating offline snapshot 33ef18e9-9f57-4ee2-81cb-03645f852eef of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-23d7af18-ee2a-411f-9426-98118b64029d tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-26710c85-2ac0-4f8e-9a28-2515a6ac2fb9-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:49 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Volume volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4 (ae8019ad-93c3-447c-b106-8db1eaa9a9f4): created successfully
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faf0eb2-7c8b-403b-b7b7-dcf55a525334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (74e5c7a6-1a84-4ee6-bf9f-1dc9129f232f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b68396-317c-4163-917e-0a70d0283599]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-14e401d6-abda-4066-9a38-0fd96da7a04d tempest-VolumesGetTest-1270140323 None] Created volume successfully.
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-1a7237b6-8c72-419c-8f9d-85f6b179b93d-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-1a7237b6-8c72-419c-8f9d-85f6b179b93d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:49 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:47:49 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "cinder-quobyte-1a7237b6-8c72-419c-8f9d-85f6b179b93d" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-1a7237b6-8c72-419c-8f9d-85f6b179b93d" acquired by "delete_volume" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a529659-ec47-4c56-b3fb-520d69da06be]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:49 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d
Apr 13 18:47:49 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:50 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.494s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:50 devstack sudo[88823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef 1G
Apr 13 18:47:50 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:50 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d" returned: 0 in 0.497s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:50 devstack sudo[88828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d
Apr 13 18:47:50 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:50 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef 1G" returned: 0 in 0.537s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:50 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef
Apr 13 18:47:50 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:50 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1a7237b6-8c72-419c-8f9d-85f6b179b93d" returned: 0 in 0.471s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-quobyte-1a7237b6-8c72-419c-8f9d-85f6b179b93d" released by "delete_volume" :: held 1.005s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Created reservations ['7c45c90a-9c92-41f8-bdda-6c37b821b792', 'ea8def99-dfef-4d88-8b7d-b772c4e4042b', 'cbad4940-5830-4948-b226-73f0d6e01db0', 'dcc7feec-bc7d-4730-8654-e971e11c1b0d'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:51 devstack sudo[88836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:51 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (0bf758c3-4d91-49d1-8805-7303b80d7acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9401fdac-e5b4-4ec1-826f-93279cdc5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9401fdac-e5b4-4ec1-826f-93279cdc5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1568185219',display_name='tempest-VolumesGetTest-Volume-1930974603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dc2a19-e187-4240-91c0-f215416a514b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:51Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d11d8a-f978-423d-8338-31b7a22c9784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d11d8a-f978-423d-8338-31b7a22c9784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2754999-0b08-4918-bdc3-d41e803658e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2754999-0b08-4918-bdc3-d41e803658e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57dc2a19-e187-4240-91c0-f215416a514b', 'volume_name': 'volume-57dc2a19-e187-4240-91c0-f215416a514b', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e086f4-38a5-436d-8339-e01743620fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e086f4-38a5-436d-8339-e01743620fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab5b3c9-ac65-4cea-9620-cea05c69e560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:51 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Volume 57dc2a19-e187-4240-91c0-f215416a514b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57dc2a19-e187-4240-91c0-f215416a514b', 'volume_size': 1}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:51 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef" returned: 0 in 0.510s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:51 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef is being set with open permissions: ugo+rw
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:51 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef
Apr 13 18:47:51 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:51 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.460s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:51 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Deleted volume successfully.
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db6bbe91-e8bf-4aca-8ad3-603bec40286e tempest-CreateVolumesFromSnapshotTest-1744157577 None] Lock "cinder-1a7237b6-8c72-419c-8f9d-85f6b179b93d-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:51 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef" returned: 0 in 0.400s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.723s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-701164334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e7e570-3050-4720-8f49-11ed4cb89120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d489c827e5848caaa857053cb1e30f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:43Z,use_quota=True,user_id='6508e4f2868845cda48a57cab44edc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Creating volume f4e7e570-3050-4720-8f49-11ed4cb89120 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:51 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:51 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120 1073741824
Apr 13 18:47:51 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:51 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bfbd97df-35c7-4269-b7b6-4deb30223f98 tempest-SnapshotsActionsTest-1928959964 None] Create snapshot completed successfully
Apr 13 18:47:52 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120 1073741824" returned: 0 in 0.516s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:52 devstack sudo[88850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120
Apr 13 18:47:52 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-33ef18e9-9f57-4ee2-81cb-03645f852eef-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-33ef18e9-9f57-4ee2-81cb-03645f852eef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-quobyte-33ef18e9-9f57-4ee2-81cb-03645f852eef" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-33ef18e9-9f57-4ee2-81cb-03645f852eef" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Deleting offline snapshot 33ef18e9-9f57-4ee2-81cb-03645f852eef of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] snapshot_file for this snap is: volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5708444-35b2-4ba6-9914-fe926c1fc39c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:52 devstack sudo[88852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef
Apr 13 18:47:52 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:52 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120" returned: 0 in 0.482s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1568185219',display_name='tempest-VolumesGetTest-Volume-1930974603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57dc2a19-e187-4240-91c0-f215416a514b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:51Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Creating volume 57dc2a19-e187-4240-91c0-f215416a514b {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:52 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f257aa7-d02f-4ff1-8789-a4150b5c6d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e7e570-3050-4720-8f49-11ed4cb89120', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a2ad89-2012-4ee4-bf20-c28ae6123b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:52 devstack sudo[88855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b 1073741824
Apr 13 18:47:52 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:52 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume volume-f4e7e570-3050-4720-8f49-11ed4cb89120 (f4e7e570-3050-4720-8f49-11ed4cb89120): created successfully
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a2ad89-2012-4ee4-bf20-c28ae6123b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (ac8817c9-d0f6-4a22-977d-ab91069f730e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:52 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-21500029-db04-43d5-bd73-70bce86c3d45 tempest-VolumesSnapshotTestJSON-1020932222 None] Created volume successfully.
Apr 13 18:47:53 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef" returned: 0 in 0.554s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c901ef5-c9a3-4840-9ac1-746eb5611c60]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:53 devstack sudo[88860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:47:53 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:53 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b 1073741824" returned: 0 in 0.498s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:53 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b
Apr 13 18:47:53 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:53 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.492s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:53 devstack sudo[88870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef
Apr 13 18:47:53 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:53 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b" returned: 0 in 0.460s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.111s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ab5b3c9-ac65-4cea-9620-cea05c69e560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57dc2a19-e187-4240-91c0-f215416a514b', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504e3909-85a5-4460-a326-e50698707710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Creating offline snapshot 458f90f9-5eb5-4ffa-a5d9-8a774c84efad of volume f4e7e570-3050-4720-8f49-11ed4cb89120 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:47:53 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Volume volume-57dc2a19-e187-4240-91c0-f215416a514b (57dc2a19-e187-4240-91c0-f215416a514b): created successfully
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504e3909-85a5-4460-a326-e50698707710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (0bf758c3-4d91-49d1-8805-7303b80d7acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37b1bb3-c05a-482f-85b2-c68fe1ac8510]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-163a91c4-cb8e-475b-a86c-86cc3d37a642 tempest-VolumesGetTest-1270140323 None] Created volume successfully.
Apr 13 18:47:53 devstack sudo[88874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120
Apr 13 18:47:53 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:54 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:54 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef
Apr 13 18:47:54 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:54 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120" returned: 0 in 0.489s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:54 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad 1G
Apr 13 18:47:54 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-57dc2a19-e187-4240-91c0-f215416a514b-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Lock "cinder-57dc2a19-e187-4240-91c0-f215416a514b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-quobyte-57dc2a19-e187-4240-91c0-f215416a514b" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-57dc2a19-e187-4240-91c0-f215416a514b" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6744e42e-0ff0-4965-896b-1ab5a65f739d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:54 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.33ef18e9-9f57-4ee2-81cb-03645f852eef" returned: 0 in 0.477s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-33ef18e9-9f57-4ee2-81cb-03645f852eef" released by "_delete_snapshot" :: held 2.086s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" released by "delete_snapshot" :: held 2.103s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=183,cinder:UPDATE=272,cinder:INSERT=54,cinder:DELETE=22 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:47:54 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b
Apr 13 18:47:54 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Created reservations ['7635ca75-1fb6-4dd9-863c-3a25651d1d7d', 'bb6e18e8-a35c-4b79-90dc-2ff456ba394b', 'a6d4aa4a-bc23-4508-b1f7-20598224e774', '06c1023e-3037-4aaa-8976-04d679ec43c6'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:54 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Delete snapshot completed successfully.
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2dfe1ee9-c416-4d8e-becc-9a52499c0ae5 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-33ef18e9-9f57-4ee2-81cb-03645f852eef-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:54 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad 1G" returned: 0 in 0.560s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4e7e570-3050-4720-8f49-11ed4cb89120 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:54 devstack sudo[88895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4e7e570-3050-4720-8f49-11ed4cb89120 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad
Apr 13 18:47:54 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:54 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b" returned: 0 in 0.484s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:54 devstack sudo[88897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b
Apr 13 18:47:54 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:55 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4e7e570-3050-4720-8f49-11ed4cb89120 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad" returned: 0 in 0.429s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:55 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad is being set with open permissions: ugo+rw
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:55 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad
Apr 13 18:47:55 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:55 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-57dc2a19-e187-4240-91c0-f215416a514b" returned: 0 in 0.393s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-57dc2a19-e187-4240-91c0-f215416a514b" released by "delete_volume" :: held 0.904s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=189,cinder:UPDATE=215,cinder:DELETE=19,cinder:INSERT=65 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Created reservations ['009d9b2c-aacf-4c51-a036-a78c9c34cfa8', '8113bbca-0e0f-4a89-ac85-d0bfef0edc4f', '6dc647af-ded7-4619-afcc-6295f4b6ade9', '96974c32-2bf6-4836-a1d1-7bcf32e74640'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:55 devstack sudo[88905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:55 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-ae8019ad-93c3-447c-b106-8db1eaa9a9f4-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Lock "cinder-ae8019ad-93c3-447c-b106-8db1eaa9a9f4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-quobyte-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" acquired by "delete_volume" :: waited 0.018s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bfc8f7-d237-4f21-a70d-f4c6a4a296d1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:55 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4
Apr 13 18:47:55 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:55 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:55 devstack sudo[88911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.info
Apr 13 18:47:55 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:55 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:55 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Deleted volume successfully.
Apr 13 18:47:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bf5a4225-9516-4cbe-8947-35f03f85a2e1 tempest-VolumesGetTest-1270140323 None] Lock "cinder-57dc2a19-e187-4240-91c0-f215416a514b-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:56 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" returned: 0 in 0.505s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:56 devstack sudo[88917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4
Apr 13 18:47:56 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:56 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.info" returned: 0 in 0.435s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:56 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.info is being set with open permissions: ugo+rw
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:56 devstack sudo[88919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.info
Apr 13 18:47:56 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:56 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" returned: 0 in 0.434s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-ae8019ad-93c3-447c-b106-8db1eaa9a9f4" released by "delete_volume" :: held 0.969s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Created reservations ['6b514e78-c4c3-4eb9-a0c9-202b0fd606aa', 'be1f851a-33de-46bf-8cfc-080b60f504d4', '0997fe77-7c3f-4e28-8661-d981d1491942', 'a887eb42-1e35-4f67-9b20-b256ac9fd33e'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:56 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.info" returned: 0 in 0.417s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.964s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Creating offline snapshot 56571bc4-3c93-4e9d-a031-a8a48da4bd29 of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1758902b-cd88-4b4f-bbc0-c416f25a2adb]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-97d8490a-862d-4985-8887-5446303122b3 tempest-VolumesSnapshotTestJSON-1020932222 None] Create snapshot completed successfully
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-96bd6503-ecf2-4f80-a267-1f400b170dad-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Lock "cinder-96bd6503-ecf2-4f80-a267-1f400b170dad-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:56 devstack sudo[88924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:56 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:56 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:47:56 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-quobyte-96bd6503-ecf2-4f80-a267-1f400b170dad" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-96bd6503-ecf2-4f80-a267-1f400b170dad" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[23416d03-0406-40ca-a1a5-c9baeea75cc9]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:56 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad
Apr 13 18:47:56 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:57 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.441s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:57 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Deleted volume successfully.
Apr 13 18:47:57 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.489s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-46d6b83a-7f95-4c80-a968-5265db6cbb57 tempest-VolumesGetTest-1270140323 None] Lock "cinder-ae8019ad-93c3-447c-b106-8db1eaa9a9f4-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:57 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 1G
Apr 13 18:47:57 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:57 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad" returned: 0 in 0.467s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:57 devstack sudo[88938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad
Apr 13 18:47:57 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:57 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 1G" returned: 0 in 0.467s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:57 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29
Apr 13 18:47:57 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:57 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-96bd6503-ecf2-4f80-a267-1f400b170dad" returned: 0 in 0.434s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-96bd6503-ecf2-4f80-a267-1f400b170dad" released by "delete_volume" :: held 0.928s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Created reservations ['6adca8f0-bb8c-4aaa-88c4-1f4656c28bae', '4f56b7bb-da6f-4a45-a959-ed476c85e709', '5dd47ef1-b0ee-452d-aa67-7db0f2c1bdcf', 'e047427f-959d-4567-9b63-bd6db215c7f4'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:57 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:47:57 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-458f90f9-5eb5-4ffa-a5d9-8a774c84efad-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-458f90f9-5eb5-4ffa-a5d9-8a774c84efad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-f4e7e570-3050-4720-8f49-11ed4cb89120" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-f4e7e570-3050-4720-8f49-11ed4cb89120" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-458f90f9-5eb5-4ffa-a5d9-8a774c84efad" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-458f90f9-5eb5-4ffa-a5d9-8a774c84efad" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Deleting offline snapshot 458f90f9-5eb5-4ffa-a5d9-8a774c84efad of volume f4e7e570-3050-4720-8f49-11ed4cb89120 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] snapshot_file for this snap is: volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eac8dc-ba2d-4237-88b5-f74f3d100043]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:58 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad
Apr 13 18:47:58 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:58 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29" returned: 0 in 0.561s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:58 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 is being set with open permissions: ugo+rw
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:58 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29
Apr 13 18:47:58 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (86b670df-4a75-489a-af63-f9082abc408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8ec428-fd0c-47b7-9f6e-901830c2d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8ec428-fd0c-47b7-9f6e-901830c2d22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745055490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:58Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6141807b-29dc-4d86-bde6-d08fa8005d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6141807b-29dc-4d86-bde6-d08fa8005d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739754c9-8288-40c7-ae53-5599996169ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.image.glance [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Creating Keystone auth plugin from conf {{(pid=82517) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 18:47:58 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.580s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:47:58 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Deleted volume successfully.
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-aa50bfa3-00fa-4dfc-b473-4168308278ae tempest-VolumesGetTest-1270140323 None] Lock "cinder-96bd6503-ecf2-4f80-a267-1f400b170dad-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:47:58 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad" returned: 0 in 0.551s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4e7e570-3050-4720-8f49-11ed4cb89120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a4088f-e201-4389-8320-7f9f05ae9370]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739754c9-8288-40c7-ae53-5599996169ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94', 'volume_name': 'volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0c1e8850>}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb38575-d41a-4b2d-8a99-e389968c9839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb38575-d41a-4b2d-8a99-e389968c9839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f60f355-8bde-4dac-a57a-c8e40553f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:47:58 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Volume 34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0c1e8850>}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Trying to clone 34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 from image e0058cc9-8f67-429f-9701-e23c6990051f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]). {{(pid=82517) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 18:47:58 devstack sudo[88959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120
Apr 13 18:47:58 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:58 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 18:47:58 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29" returned: 0 in 0.500s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f08ec-6ea9-404e-b533-723d9e64d4e4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:58 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5f760a7c-951b-4e0d-b9ef-7a6820d14500 tempest-SnapshotsActionsTest-1928959964 None] Create snapshot completed successfully
Apr 13 18:47:58 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD
Apr 13 18:47:58 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:59 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120" returned: 0 in 0.505s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:59 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad
Apr 13 18:47:59 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:59 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Temporary image e0058cc9-8f67-429f-9701-e23c6990051f is fetched for user 80a8d23e32e04c61913b313ce615fc6b. {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[da390661-4cee-4d8f-a944-7e113793540a]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:59 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD
Apr 13 18:47:59 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:59 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad" returned: 0 in 0.455s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:59 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad
Apr 13 18:47:59 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:59 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1745055490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:47:58Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Creating volume 34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:47:59 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:59 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 1073741824
Apr 13 18:47:59 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-56571bc4-3c93-4e9d-a031-a8a48da4bd29-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-56571bc4-3c93-4e9d-a031-a8a48da4bd29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-quobyte-56571bc4-3c93-4e9d-a031-a8a48da4bd29" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-56571bc4-3c93-4e9d-a031-a8a48da4bd29" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Deleting offline snapshot 56571bc4-3c93-4e9d-a031-a8a48da4bd29 of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] snapshot_file for this snap is: volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fbfae5-3a2b-4e8d-b78f-d4a97f0a5e3e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:47:59 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Apr 13 18:47:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120.458f90f9-5eb5-4ffa-a5d9-8a774c84efad" returned: 0 in 0.428s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-458f90f9-5eb5-4ffa-a5d9-8a774c84efad" released by "_delete_snapshot" :: held 1.995s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-f4e7e570-3050-4720-8f49-11ed4cb89120" released by "delete_snapshot" :: held 2.010s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:00 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29
Apr 13 18:48:00 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Created reservations ['8445332e-67f8-4ce4-b4f2-1f1aeeacde9d', '633b9ee4-2419-4d75-92a0-50a998192ec4', '3d2b1f06-e8e0-403f-b36d-a9e7e821f964', 'ec7c10c2-0dee-465c-b98d-8e65ae53c63a'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:00 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Delete snapshot completed successfully.
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5739940b-8513-4a33-a055-5440462f77b6 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-458f90f9-5eb5-4ffa-a5d9-8a774c84efad-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:00 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 1073741824" returned: 0 in 0.483s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:00 devstack sudo[88991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94
Apr 13 18:48:00 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:00 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29" returned: 0 in 0.491s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4aa62e-8797-49de-872d-308dd12b02c4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:00 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:48:00 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:00 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" returned: 0 in 0.409s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Attempting download of e0058cc9-8f67-429f-9701-e23c6990051f ((None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}])) to volume 34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94. {{(pid=82517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8414a51-a76b-46d9-b8d8-3702cdb4ba84]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0tctrd3z {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:00 devstack sudo[88999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0tctrd3z
Apr 13 18:48:00 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_service.periodic_task [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:00 devstack sudo[89004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:00 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:00 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.480s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:00 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29
Apr 13 18:48:00 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:01 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0tctrd3z" returned: 0 in 0.576s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0tctrd3z {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (ec7188f9-c31a-40af-a37a-ef0eee2c00a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e65165-cbc9-4d40-9dd0-9611c3ad3751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:01 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e65165-cbc9-4d40-9dd0-9611c3ad3751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2119553574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645c457e-b992-424b-a1ba-9d71e3c35e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d489c827e5848caaa857053cb1e30f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:01Z,use_quota=True,user_id='6508e4f2868845cda48a57cab44edc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ca1520-2fc7-4fa7-bd1d-8234b931fc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ca1520-2fc7-4fa7-bd1d-8234b931fc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:01 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0tctrd3z
Apr 13 18:48:01 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf6c2a6-14a9-4dc2-965a-e0f98fd2d1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf6c2a6-14a9-4dc2-965a-e0f98fd2d1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645c457e-b992-424b-a1ba-9d71e3c35e66', 'volume_name': 'volume-645c457e-b992-424b-a1ba-9d71e3c35e66', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d9c0b2-c7ab-4fb3-81af-8a66849449a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d9c0b2-c7ab-4fb3-81af-8a66849449a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6878c5b1-5a94-40b2-9d3c-6d13316e8a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:01 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume 645c457e-b992-424b-a1ba-9d71e3c35e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645c457e-b992-424b-a1ba-9d71e3c35e66', 'volume_size': 1}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2119553574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645c457e-b992-424b-a1ba-9d71e3c35e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d489c827e5848caaa857053cb1e30f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:01Z,use_quota=True,user_id='6508e4f2868845cda48a57cab44edc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Creating volume 645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:01 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:01 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.563s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29" returned: 0 in 0.528s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:01 devstack sudo[89016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 1073741824
Apr 13 18:48:01 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:01 devstack sudo[89018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29
Apr 13 18:48:01 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:01 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0tctrd3z" returned: 1 in 0.470s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0058cc9-8f67-429f-9701-e23c6990051f_0tctrd3z' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1defae34-c760-428d-973c-3b826adc3cea]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:01 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD
Apr 13 18:48:01 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:01 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.56571bc4-3c93-4e9d-a031-a8a48da4bd29" returned: 0 in 0.440s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-56571bc4-3c93-4e9d-a031-a8a48da4bd29" released by "_delete_snapshot" :: held 1.983s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" released by "delete_snapshot" :: held 1.994s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:01 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 1073741824" returned: 0 in 0.487s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:01 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66
Apr 13 18:48:01 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:01 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Created reservations ['7634681c-1db8-4e4b-b8a9-8b5cba07bff9', 'be500cbb-04b3-4b6f-a069-cdceba5a87dd', '9b69fe7f-f6e2-41fe-923e-861f4c6b6d3a', '1288b5fe-141b-4d3d-8c8d-495116bd155e'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:02 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Delete snapshot completed successfully.
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-74615355-88cf-4038-b9de-7ab0c153fa20 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-56571bc4-3c93-4e9d-a031-a8a48da4bd29-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:02 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] e0058cc9-8f67-429f-9701-e23c6990051f was qcow2, converting to raw {{(pid=82517) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:02 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94
Apr 13 18:48:02 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:02 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66" returned: 0 in 0.411s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6878c5b1-5a94-40b2-9d3c-6d13316e8a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645c457e-b992-424b-a1ba-9d71e3c35e66', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5d62a9-44de-4f4f-ad7d-498919243578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:02 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume volume-645c457e-b992-424b-a1ba-9d71e3c35e66 (645c457e-b992-424b-a1ba-9d71e3c35e66): created successfully
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5d62a9-44de-4f4f-ad7d-498919243578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:02 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (ec7188f9-c31a-40af-a37a-ef0eee2c00a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:02 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d0ff7db4-183f-484b-9ef8-aa3305c20cc2 tempest-VolumesSnapshotTestJSON-1020932222 None] Created volume successfully.
Apr 13 18:48:03 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" returned: 0 in 0.820s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e0058cc9-8f67-429f-9701-e23c6990051f_5xkmys7vdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:48:03 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Converted 112.00 MB image at 112.00 MB/s
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:03 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 1G
Apr 13 18:48:03 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Creating offline snapshot 96046f81-55dd-4329-bea9-1b45c013dc94 of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a55317-5349-4e50-ad44-8013e1c34443]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:03 devstack sudo[89049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:48:03 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:03 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 1G" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7b12e2-3dd0-4b27-a440-e9c9cc6bfb3b]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:03 devstack sudo[89055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94
Apr 13 18:48:03 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:03 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.516s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:03 devstack sudo[89060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 1G
Apr 13 18:48:03 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:04 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" returned: 0 in 0.468s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:04 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94
Apr 13 18:48:04 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:04 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 1G" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:04 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94
Apr 13 18:48:04 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:04 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" returned: 1 in 0.481s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Downloaded image e0058cc9-8f67-429f-9701-e23c6990051f ((None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}])) to volume 34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 successfully. {{(pid=82517) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Temporary image e0058cc9-8f67-429f-9701-e23c6990051f for user 80a8d23e32e04c61913b313ce615fc6b is deleted. {{(pid=82517) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG cinder.volume.volume_utils [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Marking volume 34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 as bootable. {{(pid=82517) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Copying metadata from image e0058cc9-8f67-429f-9701-e23c6990051f to 34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94. {{(pid=82517) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Creating volume glance metadata for volume 34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 backed by image e0058cc9-8f67-429f-9701-e23c6990051f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82517) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f60f355-8bde-4dac-a57a-c8e40553f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94', 'volume_size': 1, 'image_id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e0058cc9-8f67-429f-9701-e23c6990051f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7aa82e6f33a940ea9fcf0d8f2998e74c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e0058cc9-8f67-429f-9701-e23c6990051f', 'created_at': datetime.datetime(2026, 4, 13, 16, 37, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 16, 37, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0058cc9-8f67-429f-9701-e23c6990051f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9e0c1e8850>}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9e3732-d277-4b34-aac8-39078fba6ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:04 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Volume volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 (34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94): created successfully
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9e3732-d277-4b34-aac8-39078fba6ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (86b670df-4a75-489a-af63-f9082abc408e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:04 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ec6ccb9b-db26-416f-8403-79b2fd4dd66f tempest-VolumesGetTest-1270140323 None] Created volume successfully.
Apr 13 18:48:04 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94" returned: 0 in 0.453s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:04 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 is being set with open permissions: ugo+rw
Apr 13 18:48:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:04 devstack sudo[89077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94
Apr 13 18:48:04 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:05 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94" returned: 0 in 0.412s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.623s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Creating offline snapshot 648afb3f-fd0b-4d16-a4ff-85aafccb5b11 of volume 645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:48:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d37e414f-c4eb-42bd-ba43-574e84cd21b9 tempest-SnapshotsActionsTest-1928959964 None] Create snapshot completed successfully
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cb5f7d-8448-438f-8159-83f8666f8136]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:05 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66
Apr 13 18:48:05 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-96046f81-55dd-4329-bea9-1b45c013dc94-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-96046f81-55dd-4329-bea9-1b45c013dc94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-quobyte-96046f81-55dd-4329-bea9-1b45c013dc94" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-96046f81-55dd-4329-bea9-1b45c013dc94" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Deleting offline snapshot 96046f81-55dd-4329-bea9-1b45c013dc94 of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] snapshot_file for this snap is: volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d3b916-0852-41c3-8a9e-818694d175d2]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:05 devstack sudo[89082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94
Apr 13 18:48:05 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:05 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66" returned: 0 in 0.497s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:05 devstack sudo[89087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 1G
Apr 13 18:48:05 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:05 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94" returned: 0 in 0.561s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f3958b-7ca6-4535-8348-5c5b838041eb]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (d0d3d21e-52d4-4f35-8526-bf9b250052a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:06 devstack sudo[89092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:48:06 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a90bba-aa81-4db3-b0c9-c566b97deeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a90bba-aa81-4db3-b0c9-c566b97deeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1246125504',display_name='tempest-VolumesGetTest-Volume-686655276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67cc1b3-160e-4366-a2b4-8c301529a006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:06Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b17d170-d1fc-44cb-a31d-aec9cf5fd515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b17d170-d1fc-44cb-a31d-aec9cf5fd515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebb8e40-5339-4627-950a-181903db0ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebb8e40-5339-4627-950a-181903db0ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b67cc1b3-160e-4366-a2b4-8c301529a006', 'volume_name': 'volume-b67cc1b3-160e-4366-a2b4-8c301529a006', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403d1e23-c9dc-4d23-8397-cf049a049de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403d1e23-c9dc-4d23-8397-cf049a049de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee77b75d-27fd-477e-8b68-da50e9d8b401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:06 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Volume b67cc1b3-160e-4366-a2b4-8c301529a006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b67cc1b3-160e-4366-a2b4-8c301529a006', 'volume_size': 1}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:06 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 1G" returned: 0 in 0.506s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645c457e-b992-424b-a1ba-9d71e3c35e66 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:06 devstack sudo[89097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645c457e-b992-424b-a1ba-9d71e3c35e66 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11
Apr 13 18:48:06 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:06 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.504s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:06 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94
Apr 13 18:48:06 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:06 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645c457e-b992-424b-a1ba-9d71e3c35e66 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11" returned: 0 in 0.423s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:06 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 is being set with open permissions: ugo+rw
Apr 13 18:48:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:06 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11
Apr 13 18:48:06 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:07 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94" returned: 0 in 0.480s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:07 devstack sudo[89113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94
Apr 13 18:48:07 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:07 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11" returned: 0 in 0.427s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:07 devstack sudo[89115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.info
Apr 13 18:48:07 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:07 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.96046f81-55dd-4329-bea9-1b45c013dc94" returned: 0 in 0.480s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-96046f81-55dd-4329-bea9-1b45c013dc94" released by "_delete_snapshot" :: held 2.075s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" released by "delete_snapshot" :: held 2.088s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:07 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.info" returned: 0 in 0.434s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:07 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.info is being set with open permissions: ugo+rw
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:07 devstack sudo[89120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.info
Apr 13 18:48:07 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Created reservations ['d71347b2-644a-41f7-85e5-0843525428eb', 'ec75e860-1be6-4de8-abe9-8fa24c25c03c', '5aaf1b09-bbe8-472c-83fa-f3590932cee0', 'd4e086ce-7dd2-4d3f-97cb-8624d1e69361'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:07 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Delete snapshot completed successfully.
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f44dc05-7ba7-4374-b3d4-0177468e85d2 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-96046f81-55dd-4329-bea9-1b45c013dc94-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:07 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.info" returned: 0 in 0.406s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.762s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.786s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1246125504',display_name='tempest-VolumesGetTest-Volume-686655276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67cc1b3-160e-4366-a2b4-8c301529a006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947889e3dfda411a9cd5dad0aa2dbb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:06Z,use_quota=True,user_id='80a8d23e32e04c61913b313ce615fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Creating volume b67cc1b3-160e-4366-a2b4-8c301529a006 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:07 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:07 devstack sudo[89123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006 1073741824
Apr 13 18:48:07 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:07 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-db5c130b-6e30-4fab-8b9f-1102867b45b5 tempest-VolumesSnapshotTestJSON-1020932222 None] Create snapshot completed successfully
Apr 13 18:48:08 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006 1073741824" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:08 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006
Apr 13 18:48:08 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:08 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006" returned: 0 in 0.413s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.144s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee77b75d-27fd-477e-8b68-da50e9d8b401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b67cc1b3-160e-4366-a2b4-8c301529a006', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3332fa07-4a4a-4db4-897a-6bdb59bd0757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Creating offline snapshot d052dd5d-71f5-4972-9022-fb5437bead3d of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:48:08 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Volume volume-b67cc1b3-160e-4366-a2b4-8c301529a006 (b67cc1b3-160e-4366-a2b4-8c301529a006): created successfully
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3332fa07-4a4a-4db4-897a-6bdb59bd0757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Flow 'volume_create_manager' (d0d3d21e-52d4-4f35-8526-bf9b250052a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e6128-7d8d-4352-ba01-35f6f9034153]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:08 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5683f432-2fd3-493e-8292-fe1c4443dddd tempest-VolumesGetTest-1270140323 None] Created volume successfully.
Apr 13 18:48:08 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (25c4b0f9-2a66-453e-999e-a435e974205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a8d80b-7b16-4a57-a2f4-a7c236b7541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:09 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:48:09 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a8d80b-7b16-4a57-a2f4-a7c236b7541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1829866856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4786fd-e510-4d3f-a931-96d224dd620a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d489c827e5848caaa857053cb1e30f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=648afb3f-fd0b-4d16-a4ff-85aafccb5b11,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:09Z,use_quota=True,user_id='6508e4f2868845cda48a57cab44edc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90c629a-72c1-4eb2-bc95-2f1a24f605fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90c629a-72c1-4eb2-bc95-2f1a24f605fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ae8953-ec69-4035-b6a5-2d3d035ad153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ae8953-ec69-4035-b6a5-2d3d035ad153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e4786fd-e510-4d3f-a931-96d224dd620a', 'volume_name': 'volume-0e4786fd-e510-4d3f-a931-96d224dd620a', 'volume_size': 2, 'snapshot_id': '648afb3f-fd0b-4d16-a4ff-85aafccb5b11'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d45c49-6ca8-4644-836f-55d5235607ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d45c49-6ca8-4644-836f-55d5235607ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a322c62c-3a36-4884-ae2f-baab2084ce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:09 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume 0e4786fd-e510-4d3f-a931-96d224dd620a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e4786fd-e510-4d3f-a931-96d224dd620a', 'volume_size': 2, 'snapshot_id': '648afb3f-fd0b-4d16-a4ff-85aafccb5b11'}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-b67cc1b3-160e-4366-a2b4-8c301529a006-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Lock "cinder-b67cc1b3-160e-4366-a2b4-8c301529a006-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-quobyte-b67cc1b3-160e-4366-a2b4-8c301529a006" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-b67cc1b3-160e-4366-a2b4-8c301529a006" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64afe4c-dad1-435b-9d62-b302fa76da35]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:09 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.514s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:09 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006
Apr 13 18:48:09 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:09 devstack sudo[89137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d 1G
Apr 13 18:48:09 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:09 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006" returned: 0 in 0.498s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:09 devstack sudo[89146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006
Apr 13 18:48:09 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:09 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d 1G" returned: 0 in 0.480s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:09 devstack sudo[89148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d
Apr 13 18:48:09 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:10 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b67cc1b3-160e-4366-a2b4-8c301529a006" returned: 0 in 0.416s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-b67cc1b3-160e-4366-a2b4-8c301529a006" released by "delete_volume" :: held 0.937s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Created reservations ['280ddb60-dc6a-44f2-81f7-a5189514046c', 'a40ad465-acab-4f84-9355-bcc98840b1b4', '5650cb16-4b98-4a08-9f58-6c4aa96c2a76', '99d7b648-cfe2-480e-bdb6-43b81ad2a962'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:10 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d" returned: 0 in 0.445s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:10 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d is being set with open permissions: ugo+rw
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:10 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:10 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:10 devstack sudo[89156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:10 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Lock "cinder-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Acquiring lock "cinder-quobyte-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" acquired by "delete_volume" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b757b569-edab-4bee-b1b0-acdd426dd3d8]: (4, 'raw') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:10 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94
Apr 13 18:48:10 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:10 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d" returned: 0 in 0.417s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.761s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-648afb3f-fd0b-4d16-a4ff-85aafccb5b11-0e4786fd-e510-4d3f-a931-96d224dd620a" by "_create_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-648afb3f-fd0b-4d16-a4ff-85aafccb5b11-0e4786fd-e510-4d3f-a931-96d224dd620a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Creating volume 0e4786fd-e510-4d3f-a931-96d224dd620a from snapshot 648afb3f-fd0b-4d16-a4ff-85aafccb5b11 {{(pid=82517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-0e4786fd-e510-4d3f-a931-96d224dd620a" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:10 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:10 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b2b49c56-16c0-4f8f-8df2-01723240c253 tempest-SnapshotsActionsTest-1928959964 None] Create snapshot completed successfully
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-0e4786fd-e510-4d3f-a931-96d224dd620a" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] snapshot: 648afb3f-fd0b-4d16-a4ff-85aafccb5b11, volume: 0e4786fd-e510-4d3f-a931-96d224dd620a,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.463s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:10 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Deleted volume successfully.
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4cd1158a-db6d-43c7-9267-7da2dc2346b6 tempest-VolumesGetTest-1270140323 None] Lock "cinder-b67cc1b3-160e-4366-a2b4-8c301529a006-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d819a32-79f8-4a28-a701-028d8cffc0cd]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:10 devstack sudo[89162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11
Apr 13 18:48:10 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:11 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" returned: 0 in 0.507s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:11 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94
Apr 13 18:48:11 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:11 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11" returned: 0 in 0.477s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645c457e-b992-424b-a1ba-9d71e3c35e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb189cf5-2c1b-4f87-8bd5-9185cc256f92]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:11 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66
Apr 13 18:48:11 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:11 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" returned: 1 in 0.456s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94' failed. Not Retrying. {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:11 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94
Apr 13 18:48:11 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:11 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66" returned: 0 in 0.481s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:11 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a
Apr 13 18:48:11 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-d052dd5d-71f5-4972-9022-fb5437bead3d-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-d052dd5d-71f5-4972-9022-fb5437bead3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Acquiring lock "cinder-quobyte-d052dd5d-71f5-4972-9022-fb5437bead3d" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-d052dd5d-71f5-4972-9022-fb5437bead3d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Deleting offline snapshot d052dd5d-71f5-4972-9022-fb5437bead3d of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] snapshot_file for this snap is: volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c586f0d9-a3f6-4fa4-a23e-4a8092ba5baf]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:12 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" returned: 0 in 0.432s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Lock "cinder-quobyte-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94" released by "delete_volume" :: held 1.436s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Created reservations ['318f8b32-8921-4b1d-8e7b-0b57f7450881', '168d18a1-56a1-4515-9fb0-cccff048bfc5', '0c5ecfe6-0ba7-4125-88b8-9a33ea99bba8', 'bb5dccbb-5283-4bd5-9499-94c18a75897d'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:12 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d
Apr 13 18:48:12 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:12 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:12 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:12 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.491s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:12 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Deleted volume successfully.
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b638b77f-d3aa-43ae-904c-f5a2ed5c1a99 tempest-VolumesGetTest-1270140323 None] Lock "cinder-34a8a1e9-9026-4f4f-aa05-bb27d5c5ff94-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:12 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d" returned: 0 in 0.798s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b91b0cd-df32-4b3a-a8ea-05c8a755841d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:13 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:48:13 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:14 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 1.277s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:14 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d
Apr 13 18:48:14 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:14 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a" returned: 0 in 2.311s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f215e90d-9b36-421c-beae-0f2520b1f9ec]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:14 devstack sudo[89216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66
Apr 13 18:48:14 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:14 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d" returned: 0 in 0.470s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:14 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d
Apr 13 18:48:14 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:14 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66" returned: 0 in 0.674s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66, size 1024.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:48:14 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Converted 1024.00 MB image at 442.88 MB/s
Apr 13 18:48:14 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a is being set with open permissions: ugo+rw
Apr 13 18:48:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:14 devstack sudo[89226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a
Apr 13 18:48:14 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:15 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.d052dd5d-71f5-4972-9022-fb5437bead3d" returned: 0 in 0.463s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-d052dd5d-71f5-4972-9022-fb5437bead3d" released by "_delete_snapshot" :: held 3.077s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" released by "delete_snapshot" :: held 3.088s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Created reservations ['70b4af62-000a-4bc8-bbc1-88656170907d', 'b295a7c4-3698-43d1-889f-dbc79bf193e9', '6515331e-53cb-41b8-9f3e-0b3aee620728', '9ca9b869-3d4d-470b-8566-54dc9d608845'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:15 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Delete snapshot completed successfully.
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fd953cf8-3f9b-4ebf-a6f1-07688954cd37 tempest-SnapshotsActionsTest-582535068 None] Lock "cinder-d052dd5d-71f5-4972-9022-fb5437bead3d-delete_snapshot" released by "delete_snapshot" :: held 3.189s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:15 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a" returned: 0 in 0.462s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-0e4786fd-e510-4d3f-a931-96d224dd620a" released by "_copy_volume_from_snapshot" :: held 4.473s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-648afb3f-fd0b-4d16-a4ff-85aafccb5b11-0e4786fd-e510-4d3f-a931-96d224dd620a" released by "_create_volume_from_snapshot" :: held 4.505s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.521s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a322c62c-3a36-4884-ae2f-baab2084ce63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4786fd-e510-4d3f-a931-96d224dd620a', 'volume_size': 2, 'snapshot_id': '648afb3f-fd0b-4d16-a4ff-85aafccb5b11'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d0213e-9722-47f2-a7af-764bc90e8920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:15 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume volume-0e4786fd-e510-4d3f-a931-96d224dd620a (0e4786fd-e510-4d3f-a931-96d224dd620a): created successfully
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d0213e-9722-47f2-a7af-764bc90e8920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (25c4b0f9-2a66-453e-999e-a435e974205a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:15 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-7762892f-90d2-4962-8982-9fa4c8e2b629 tempest-VolumesSnapshotTestJSON-1020932222 None] Created volume successfully.
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "cinder-5f50cb93-80c0-43e9-b488-884c8e528f1e-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-0e4786fd-e510-4d3f-a931-96d224dd620a-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-5f50cb93-80c0-43e9-b488-884c8e528f1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-0e4786fd-e510-4d3f-a931-96d224dd620a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "cinder-quobyte-5f50cb93-80c0-43e9-b488-884c8e528f1e" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-quobyte-5f50cb93-80c0-43e9-b488-884c8e528f1e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Deleting offline snapshot 5f50cb93-80c0-43e9-b488-884c8e528f1e of volume 6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] snapshot_file for this snap is: volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c0eab1-47f0-40dc-98dc-4339306fa813]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-0e4786fd-e510-4d3f-a931-96d224dd620a" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-0e4786fd-e510-4d3f-a931-96d224dd620a" acquired by "delete_volume" :: waited 0.024s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dca3094-3fa7-4b50-961f-d5d65dd365ea]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:16 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:48:16 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:16 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a
Apr 13 18:48:16 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:17 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bce2a15-21c0-4231-bd35-78d267201fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaef401-eba4-4f0f-bf6f-527a9a9d25e9]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:17 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7
Apr 13 18:48:17 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Flow 'volume_create_manager' (a9010e73-537e-44a1-9a44-1bd5b1091666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ccaa91-8ad9-442f-af5f-9198808d25a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ccaa91-8ad9-442f-af5f-9198808d25a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1831775378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce48405f-d30a-4b9b-9859-a7721a7516dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f66e8a49a6994b6ba952e1c72b06adf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:17Z,use_quota=True,user_id='356bd9c7d48742f5ba0cc0a4b57f8d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1462d0d4-1a3c-494b-a2d3-c9320ad2cbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1462d0d4-1a3c-494b-a2d3-c9320ad2cbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f79a85-2cf2-40b9-8ae8-fcea50d3dd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f79a85-2cf2-40b9-8ae8-fcea50d3dd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce48405f-d30a-4b9b-9859-a7721a7516dd', 'volume_name': 'volume-ce48405f-d30a-4b9b-9859-a7721a7516dd', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92775a06-20cd-4070-bfbd-3e12d38b7458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92775a06-20cd-4070-bfbd-3e12d38b7458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:17 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697bfcd4-1d1f-46ff-a1d2-a43dff8f2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:17 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Volume ce48405f-d30a-4b9b-9859-a7721a7516dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce48405f-d30a-4b9b-9859-a7721a7516dd', 'volume_size': 1}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1831775378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce48405f-d30a-4b9b-9859-a7721a7516dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f66e8a49a6994b6ba952e1c72b06adf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:17Z,use_quota=True,user_id='356bd9c7d48742f5ba0cc0a4b57f8d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Creating volume ce48405f-d30a-4b9b-9859-a7721a7516dd {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:17 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a" returned: 0 in 0.594s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:17 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd 1073741824
Apr 13 18:48:17 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:17 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a
Apr 13 18:48:17 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:17 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7" returned: 0 in 0.489s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:17 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:48:17 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:17 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0e4786fd-e510-4d3f-a931-96d224dd620a" returned: 0 in 0.451s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-0e4786fd-e510-4d3f-a931-96d224dd620a" released by "delete_volume" :: held 1.068s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:17 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd 1073741824" returned: 0 in 0.499s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Created reservations ['5203efd1-1742-4be9-9d3e-7244c5399521', '92dcb71c-b811-4e27-819b-a71b054a40cb', '09dc79cb-0e65-4899-8c54-d8745ad65720', '0dc8d618-032e-44b3-8cbf-5240f6f10680'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:17 devstack sudo[89255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd
Apr 13 18:48:17 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:17 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:17 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:18 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.474s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:18 devstack sudo[89262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e
Apr 13 18:48:18 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:18 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd" returned: 0 in 0.391s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697bfcd4-1d1f-46ff-a1d2-a43dff8f2276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce48405f-d30a-4b9b-9859-a7721a7516dd', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fe5c0e-9037-4447-b38d-47f0ab58a284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:18 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Volume volume-ce48405f-d30a-4b9b-9859-a7721a7516dd (ce48405f-d30a-4b9b-9859-a7721a7516dd): created successfully
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fe5c0e-9037-4447-b38d-47f0ab58a284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Flow 'volume_create_manager' (a9010e73-537e-44a1-9a44-1bd5b1091666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-82512271-a030-4fe4-bdc8-fe0205e15685 tempest-VolumesListTestJSON-744548828 None] Created volume successfully.
Apr 13 18:48:18 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.425s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Deleted volume successfully.
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4536986f-faa3-46ed-84a0-f54df4447b45 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-0e4786fd-e510-4d3f-a931-96d224dd620a-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:18 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7.5f50cb93-80c0-43e9-b488-884c8e528f1e" returned: 0 in 0.441s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-quobyte-5f50cb93-80c0-43e9-b488-884c8e528f1e" released by "_delete_snapshot" :: held 1.952s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" released by "delete_snapshot" :: held 1.967s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Created reservations ['d70a4668-0100-46c8-9248-5b5fe1f78dde', '05f4146f-6ef9-4dd9-9e62-11e2a82cd6ee', 'fbe9fbdc-2553-49a9-96b7-3bce629c07e9', '6a3a8b76-9340-416b-8689-1971b9708233'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Delete snapshot completed successfully.
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2f1cf52b-3509-4fb7-8e9e-440f601b7c73 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-5f50cb93-80c0-43e9-b488-884c8e528f1e-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "cinder-6bce2a15-21c0-4231-bd35-78d267201fe7-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-6bce2a15-21c0-4231-bd35-78d267201fe7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-648afb3f-fd0b-4d16-a4ff-85aafccb5b11-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" acquired by "delete_volume" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-648afb3f-fd0b-4d16-a4ff-85aafccb5b11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-645c457e-b992-424b-a1ba-9d71e3c35e66" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[04821754-03e3-47ff-b8dc-63648d8a5526]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-645c457e-b992-424b-a1ba-9d71e3c35e66" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-648afb3f-fd0b-4d16-a4ff-85aafccb5b11" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-648afb3f-fd0b-4d16-a4ff-85aafccb5b11" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Deleting offline snapshot 648afb3f-fd0b-4d16-a4ff-85aafccb5b11 of volume 645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] snapshot_file for this snap is: volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[813e092a-73c0-42b6-8e31-dba9cfa8d86f]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:18 devstack sudo[89267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7
Apr 13 18:48:18 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:18 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11
Apr 13 18:48:18 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:19 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7" returned: 0 in 0.488s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:19 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7
Apr 13 18:48:19 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:19 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11" returned: 0 in 0.476s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645c457e-b992-424b-a1ba-9d71e3c35e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf0026-e7dd-47d5-91fe-44c11328575d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:19 devstack sudo[89279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66
Apr 13 18:48:19 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Flow 'volume_create_manager' (f27fe611-6448-4bcb-a15d-8d71d59ea0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c8045f-9082-4ebc-85ad-b79a7f3cf64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c8045f-9082-4ebc-85ad-b79a7f3cf64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1861432769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacd1480-50ff-449e-9419-e89e1145cf95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f66e8a49a6994b6ba952e1c72b06adf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:19Z,use_quota=True,user_id='356bd9c7d48742f5ba0cc0a4b57f8d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb8fc96-3dab-4fe5-85ba-4f9240f7817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb8fc96-3dab-4fe5-85ba-4f9240f7817b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb11955-3aca-469d-8653-80dbbfd44a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb11955-3aca-469d-8653-80dbbfd44a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eacd1480-50ff-449e-9419-e89e1145cf95', 'volume_name': 'volume-eacd1480-50ff-449e-9419-e89e1145cf95', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db06c50c-affa-4f07-b742-9c689d9f1598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db06c50c-affa-4f07-b742-9c689d9f1598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd25f2c-858c-4461-869e-f9870325e106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Volume eacd1480-50ff-449e-9419-e89e1145cf95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eacd1480-50ff-449e-9419-e89e1145cf95', 'volume_size': 1}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1861432769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacd1480-50ff-449e-9419-e89e1145cf95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f66e8a49a6994b6ba952e1c72b06adf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:19Z,use_quota=True,user_id='356bd9c7d48742f5ba0cc0a4b57f8d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Creating volume eacd1480-50ff-449e-9419-e89e1145cf95 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:19 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:19 devstack sudo[89281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95 1073741824
Apr 13 18:48:19 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:19 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6bce2a15-21c0-4231-bd35-78d267201fe7" returned: 0 in 0.457s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-quobyte-6bce2a15-21c0-4231-bd35-78d267201fe7" released by "delete_volume" :: held 0.978s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Created reservations ['13cf1463-bfdd-45b2-9d58-64605ef88125', '9fe298c8-622a-464c-9ff8-35b5e6e893bc', '6e0ea709-3642-48c1-9d8a-bbdb3a5834e7', '4ed940be-3fd0-4246-b522-f2370fbdc2a1'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:19 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:19 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:19 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66" returned: 0 in 0.562s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:19 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11
Apr 13 18:48:19 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:20 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95 1073741824" returned: 0 in 0.476s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:20 devstack sudo[89294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95
Apr 13 18:48:20 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:20 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.457s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Deleted volume successfully.
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6486a63f-d435-4f82-9548-a91865806605 tempest-SnapshotsActionsTest-1928959964 None] Lock "cinder-6bce2a15-21c0-4231-bd35-78d267201fe7-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:20 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11" returned: 0 in 0.468s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:20 devstack sudo[89300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11
Apr 13 18:48:20 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:20 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95" returned: 0 in 0.411s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd25f2c-858c-4461-869e-f9870325e106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eacd1480-50ff-449e-9419-e89e1145cf95', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a1633f-b63f-4899-a1a6-b73d2867c39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:20 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Volume volume-eacd1480-50ff-449e-9419-e89e1145cf95 (eacd1480-50ff-449e-9419-e89e1145cf95): created successfully
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a1633f-b63f-4899-a1a6-b73d2867c39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Flow 'volume_create_manager' (f27fe611-6448-4bcb-a15d-8d71d59ea0d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ba78f6c5-56bd-4660-bbe6-08b8a4efc6ec tempest-VolumesListTestJSON-744548828 None] Created volume successfully.
Apr 13 18:48:20 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66.648afb3f-fd0b-4d16-a4ff-85aafccb5b11" returned: 0 in 0.419s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-648afb3f-fd0b-4d16-a4ff-85aafccb5b11" released by "_delete_snapshot" :: held 1.976s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-645c457e-b992-424b-a1ba-9d71e3c35e66" released by "delete_snapshot" :: held 1.988s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Created reservations ['c0f6d589-4011-44da-87e7-b28e15764d62', 'ee4c56e9-168e-444b-b583-33306c1028cf', 'ed58f3e5-71c6-487d-971a-90a51a8e6a2a', 'e0c9d2f1-d452-410e-abc1-7a96b6c88b34'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Delete snapshot completed successfully.
Apr 13 18:48:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f16f2c92-af06-4cef-a771-1a33ca65a81c tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-648afb3f-fd0b-4d16-a4ff-85aafccb5b11-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Flow 'volume_create_manager' (913bf85d-db44-460f-af0e-d306d274c909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151a64d2-fe01-4bd9-b093-110017c796aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-645c457e-b992-424b-a1ba-9d71e3c35e66-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151a64d2-fe01-4bd9-b093-110017c796aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1245175008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1117cff2-7ef8-40d6-8932-5e6e5f438cdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f66e8a49a6994b6ba952e1c72b06adf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:22Z,use_quota=True,user_id='356bd9c7d48742f5ba0cc0a4b57f8d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93d70bb-9418-4926-a4f9-af4375d95322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93d70bb-9418-4926-a4f9-af4375d95322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb803883-be1d-460b-a6d0-4cb7ba867c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb803883-be1d-460b-a6d0-4cb7ba867c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1117cff2-7ef8-40d6-8932-5e6e5f438cdb', 'volume_name': 'volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e05322e-bb39-432c-8590-9655af3ff5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e05322e-bb39-432c-8590-9655af3ff5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d57e937-f358-4d52-b537-54ea16cf1050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:21 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Volume 1117cff2-7ef8-40d6-8932-5e6e5f438cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb', 'volume_size': 1}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1245175008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1117cff2-7ef8-40d6-8932-5e6e5f438cdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f66e8a49a6994b6ba952e1c72b06adf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:22Z,use_quota=True,user_id='356bd9c7d48742f5ba0cc0a4b57f8d33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Creating volume 1117cff2-7ef8-40d6-8932-5e6e5f438cdb {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:21 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-645c457e-b992-424b-a1ba-9d71e3c35e66-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:22 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb 1073741824
Apr 13 18:48:22 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-645c457e-b992-424b-a1ba-9d71e3c35e66" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-645c457e-b992-424b-a1ba-9d71e3c35e66" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:22 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[92efa81e-b3a9-420b-9dd2-254e4fe3e2b6]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:22 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66
Apr 13 18:48:22 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:22 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb 1073741824" returned: 0 in 0.553s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:22 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb
Apr 13 18:48:22 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:22 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66" returned: 0 in 0.590s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:22 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66
Apr 13 18:48:22 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:23 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb" returned: 0 in 0.459s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d57e937-f358-4d52-b537-54ea16cf1050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53731b6-ab98-4a64-9bf3-b394acf7c048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:23 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Volume volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb (1117cff2-7ef8-40d6-8932-5e6e5f438cdb): created successfully
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53731b6-ab98-4a64-9bf3-b394acf7c048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Flow 'volume_create_manager' (913bf85d-db44-460f-af0e-d306d274c909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e3858ee7-d562-4250-9de5-d7298a31c60d tempest-VolumesListTestJSON-744548828 None] Created volume successfully.
Apr 13 18:48:23 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-645c457e-b992-424b-a1ba-9d71e3c35e66" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-645c457e-b992-424b-a1ba-9d71e3c35e66" released by "delete_volume" :: held 1.115s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Created reservations ['6887a88b-e810-4e12-9744-e6a7b837674f', '46c93eb9-73df-4f3e-afbd-8cbe82ce8a2b', 'd8ed5a09-48f5-4ab8-808d-3ba5254f5422', '5422e412-d8c7-4cc6-9d1d-f82a91553a27'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:23 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:23 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:23 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.444s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Deleted volume successfully.
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Flow 'volume_create_manager' (89e098f7-986f-4f38-a213-da87a7bce8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f83eeb-0690-4ccc-a97f-fe6e5d6ec87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f83eeb-0690-4ccc-a97f-fe6e5d6ec87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-972964687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a7a716f4ff4c14946b125be2081f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:24Z,use_quota=True,user_id='5ba74302ba3b4bc9a8a928e5dba5a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b909754d-59d7-44ef-a258-8ed8180a3d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b909754d-59d7-44ef-a258-8ed8180a3d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f263f3-96f9-46cc-bfba-76cc129c2230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f263f3-96f9-46cc-bfba-76cc129c2230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5', 'volume_name': 'volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fefccf-d195-4a80-b173-9e8dc0073444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fefccf-d195-4a80-b173-9e8dc0073444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6b02f2-4e71-47cd-a5d6-74c9cfc36907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:23 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Volume d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5', 'volume_size': 1}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-972964687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a7a716f4ff4c14946b125be2081f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:24Z,use_quota=True,user_id='5ba74302ba3b4bc9a8a928e5dba5a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Creating volume d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:23 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-eb1b2b2f-0be7-4cdb-910d-f233d9cc3f2e tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-645c457e-b992-424b-a1ba-9d71e3c35e66-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:23 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5 1073741824
Apr 13 18:48:23 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:24 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5 1073741824" returned: 0 in 0.546s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:24 devstack sudo[89365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5
Apr 13 18:48:24 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (d6ba0eb0-6f25-4f4b-a81e-e7de99e6351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb7ac92-a1d2-46a0-a7c5-d2c96b68028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb7ac92-a1d2-46a0-a7c5-d2c96b68028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1550104461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d489c827e5848caaa857053cb1e30f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:24Z,use_quota=True,user_id='6508e4f2868845cda48a57cab44edc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd785d4-51e9-4783-920a-ef05c5f93f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd785d4-51e9-4783-920a-ef05c5f93f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f00d1b-387e-4237-bd44-ecdb40a27a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f00d1b-387e-4237-bd44-ecdb40a27a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d', 'volume_name': 'volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f4cbc7-20a4-4f71-95ff-d6cd346cc586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f4cbc7-20a4-4f71-95ff-d6cd346cc586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114acb8f-dd9a-4ca3-ac72-af400d8151c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:24 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Volume 2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d', 'volume_size': 1}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:24 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5" returned: 0 in 0.417s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1550104461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d489c827e5848caaa857053cb1e30f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:24Z,use_quota=True,user_id='6508e4f2868845cda48a57cab44edc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Creating volume 2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:24 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6b02f2-4e71-47cd-a5d6-74c9cfc36907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:24 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d 1073741824
Apr 13 18:48:24 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0784f8d-ddc4-43e0-9afe-9edada6da583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:24 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Volume volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5 (d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5): created successfully
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0784f8d-ddc4-43e0-9afe-9edada6da583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Flow 'volume_create_manager' (89e098f7-986f-4f38-a213-da87a7bce8ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:24 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bbdf8ff7-ce48-429f-be6c-f5b4c1f94ec6 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Created volume successfully.
Apr 13 18:48:25 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d 1073741824" returned: 0 in 0.498s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:25 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d
Apr 13 18:48:25 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:25 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" returned: 0 in 0.432s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114acb8f-dd9a-4ca3-ac72-af400d8151c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa80c73a-23a5-44da-a13c-101703ca2d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:25 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Volume volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d (2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d): created successfully
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa80c73a-23a5-44da-a13c-101703ca2d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (d6ba0eb0-6f25-4f4b-a81e-e7de99e6351e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:25 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4135930d-1ec1-4a6f-bac7-600a53ae2afe tempest-VolumesSnapshotTestJSON-1020932222 None] Created volume successfully.
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "cinder-1117cff2-7ef8-40d6-8932-5e6e5f438cdb-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-1117cff2-7ef8-40d6-8932-5e6e5f438cdb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "cinder-quobyte-1117cff2-7ef8-40d6-8932-5e6e5f438cdb" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-quobyte-1117cff2-7ef8-40d6-8932-5e6e5f438cdb" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a4b922-dc6c-4aec-856e-9c2aef65740f]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:26 devstack sudo[89376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb
Apr 13 18:48:26 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Acquiring lock "cinder-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "cinder-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Acquiring lock "cinder-quobyte-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "cinder-quobyte-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e2d067-e6e3-48b4-b3fa-0a4b25b17f77]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:26 devstack sudo[89378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5
Apr 13 18:48:26 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:26 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb" returned: 0 in 0.530s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:26 devstack sudo[89383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb
Apr 13 18:48:26 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Creating offline snapshot d29cdead-7122-45a1-bc93-60a805b61803 of volume 2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0778824b-f027-4849-9803-d40a7848eb72]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:26 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d
Apr 13 18:48:26 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:26 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5" returned: 0 in 0.497s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:26 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5
Apr 13 18:48:26 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:26 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1117cff2-7ef8-40d6-8932-5e6e5f438cdb" returned: 0 in 0.404s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-quobyte-1117cff2-7ef8-40d6-8932-5e6e5f438cdb" released by "delete_volume" :: held 0.959s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:26 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Created reservations ['bb4d6a2f-5922-43c1-bd14-77197d32ea37', 'e441254b-a378-4ad5-b7b9-2a48e73107be', 'e8e0226d-e883-4413-95b4-c65239de72c8', 'd30312e6-6158-449a-bf26-4b4ba8b8410f'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:27 devstack sudo[89393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:27 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "cinder-eacd1480-50ff-449e-9419-e89e1145cf95-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-eacd1480-50ff-449e-9419-e89e1145cf95-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "cinder-quobyte-eacd1480-50ff-449e-9419-e89e1145cf95" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-quobyte-eacd1480-50ff-449e-9419-e89e1145cf95" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5920b74-2230-452a-9b3f-0890e25d875d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:27 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" returned: 0 in 0.549s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:27 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5" returned: 0 in 0.472s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:27 devstack sudo[89400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 1G
Apr 13 18:48:27 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "cinder-quobyte-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5" released by "delete_volume" :: held 0.995s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:27 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95
Apr 13 18:48:27 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Created reservations ['49c04abb-c75c-4953-b403-9b6be05f846a', '784348a7-e72e-4adc-b3f1-d17ae8f611b3', '3fbb2351-9782-48c4-9bf1-0eb601547589', '0350f27b-32dd-447e-84b0-75ee524de18b'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:27 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.459s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:27 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Deleted volume successfully.
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-6a925dea-a713-4d2e-b8cf-8590ead5b654 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-1117cff2-7ef8-40d6-8932-5e6e5f438cdb-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:27 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:27 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:27 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95" returned: 0 in 0.511s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:27 devstack sudo[89412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95
Apr 13 18:48:27 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:27 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 1G" returned: 0 in 0.491s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:27 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803
Apr 13 18:48:27 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:27 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.426s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:27 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Deleted volume successfully.
Apr 13 18:48:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f97cd103-3fa5-409b-8f66-29094b5ce163 tempest-VolumeQuotasNegativeTestJSON-572746792 None] Lock "cinder-d799e2ae-b2f8-44f8-b6d9-ae9cb2bb64b5-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:28 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eacd1480-50ff-449e-9419-e89e1145cf95" returned: 0 in 0.416s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-quobyte-eacd1480-50ff-449e-9419-e89e1145cf95" released by "delete_volume" :: held 0.951s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:28 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803" returned: 0 in 0.433s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:28 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 is being set with open permissions: ugo+rw
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:28 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803
Apr 13 18:48:28 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Created reservations ['609b778f-2935-4ab0-8f47-b52d21d2627f', '8ed8a4a0-8738-42c2-b5b0-e26321a5afc6', 'e5654c77-3f17-469b-887d-2c43cb11a142', '01b656f9-fb1f-496f-a654-7762961756eb'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:28 devstack sudo[89423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:28 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:28 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803" returned: 0 in 0.426s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:28 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.407s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:28 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.info
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:28 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Deleted volume successfully.
Apr 13 18:48:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-798b6ede-511f-4e6a-9a36-601aa1613389 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-eacd1480-50ff-449e-9419-e89e1145cf95-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:29 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.info" returned: 0 in 0.501s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:29 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.info is being set with open permissions: ugo+rw
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:29 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.info
Apr 13 18:48:29 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "cinder-ce48405f-d30a-4b9b-9859-a7721a7516dd-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-ce48405f-d30a-4b9b-9859-a7721a7516dd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "cinder-quobyte-ce48405f-d30a-4b9b-9859-a7721a7516dd" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-quobyte-ce48405f-d30a-4b9b-9859-a7721a7516dd" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d87d6b9-ccaf-49e1-9547-b39d9428d4ca]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:29 devstack sudo[89432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd
Apr 13 18:48:29 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:29 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.info" returned: 0 in 0.473s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:29 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c9498948-adb5-4b54-b6a9-57c4e86fe6fa tempest-VolumesSnapshotTestJSON-1020932222 None] Create snapshot completed successfully
Apr 13 18:48:30 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd" returned: 0 in 0.537s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:30 devstack sudo[89438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd
Apr 13 18:48:30 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (93300ebf-60fd-4fc4-b712-b7d2e5a3750d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2d4e07-eab4-40d2-a00a-8092e5300abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2d4e07-eab4-40d2-a00a-8092e5300abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-932738484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90a3aab-e7cb-4a64-a149-4179770c141a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d489c827e5848caaa857053cb1e30f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d29cdead-7122-45a1-bc93-60a805b61803,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:30Z,use_quota=True,user_id='6508e4f2868845cda48a57cab44edc3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc25c7f-7f26-4bb1-8b1c-6c230ed987c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc25c7f-7f26-4bb1-8b1c-6c230ed987c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b6a292-2737-4aa8-abfc-f7bd395aa504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b6a292-2737-4aa8-abfc-f7bd395aa504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b90a3aab-e7cb-4a64-a149-4179770c141a', 'volume_name': 'volume-b90a3aab-e7cb-4a64-a149-4179770c141a', 'volume_size': 1, 'snapshot_id': 'd29cdead-7122-45a1-bc93-60a805b61803'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dceaaa4b-5568-4a4f-af44-870e4c7a2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dceaaa4b-5568-4a4f-af44-870e4c7a2cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf47e891-1064-45f0-9206-55eb877d023a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume b90a3aab-e7cb-4a64-a149-4179770c141a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b90a3aab-e7cb-4a64-a149-4179770c141a', 'volume_size': 1, 'snapshot_id': 'd29cdead-7122-45a1-bc93-60a805b61803'}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-d29cdead-7122-45a1-bc93-60a805b61803-b90a3aab-e7cb-4a64-a149-4179770c141a" by "_create_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-d29cdead-7122-45a1-bc93-60a805b61803-b90a3aab-e7cb-4a64-a149-4179770c141a" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Creating volume b90a3aab-e7cb-4a64-a149-4179770c141a from snapshot d29cdead-7122-45a1-bc93-60a805b61803 {{(pid=82517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-b90a3aab-e7cb-4a64-a149-4179770c141a" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-b90a3aab-e7cb-4a64-a149-4179770c141a" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] snapshot: d29cdead-7122-45a1-bc93-60a805b61803, volume: b90a3aab-e7cb-4a64-a149-4179770c141a,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe804c11-0f9d-4c0c-81df-490b3c61b30e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:30 devstack sudo[89440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803
Apr 13 18:48:30 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:30 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ce48405f-d30a-4b9b-9859-a7721a7516dd" returned: 0 in 0.448s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-quobyte-ce48405f-d30a-4b9b-9859-a7721a7516dd" released by "delete_volume" :: held 1.021s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Created reservations ['762f2ced-6d38-41a2-9b27-1bd3106cd5be', 'bc5a3746-899a-4b4f-adc1-059e8170fe45', '2236db4f-282d-4fd5-b411-556d29b01d51', '9419b263-9df1-4dda-8cfa-62a37ff0eb00'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:30 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:30 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:30 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803" returned: 0 in 0.496s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f671b0-eec2-4ee3-a76c-aab667de1ba9]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:30 devstack sudo[89448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d
Apr 13 18:48:30 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:31 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.539s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:31 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:31 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Deleted volume successfully.
Apr 13 18:48:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e593e04c-8858-4581-b7f2-7b48daeeee62 tempest-VolumesListTestJSON-744548828 None] Lock "cinder-ce48405f-d30a-4b9b-9859-a7721a7516dd-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:31 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" returned: 0 in 0.530s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:31 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:48:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:31 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a
Apr 13 18:48:31 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:33 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a" returned: 0 in 2.288s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:33 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb7c11-4e36-4860-a20f-ad55d23dbd4c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:33 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d
Apr 13 18:48:33 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:34 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" returned: 0 in 0.717s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:48:34 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Converted 1024.00 MB image at 447.41 MB/s
Apr 13 18:48:34 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a is being set with open permissions: ugo+rw
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:34 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a
Apr 13 18:48:34 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (a0f198e4-6c77-4139-a170-f305f84bd30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c26ebda-e13d-4d6a-b58a-e4a519af45aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c26ebda-e13d-4d6a-b58a-e4a519af45aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603207746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e6e198-530f-456f-91ca-39ee690e8020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:35Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2251cf02-7a9c-4b1e-ad25-d425496fb5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2251cf02-7a9c-4b1e-ad25-d425496fb5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad227c7-816e-4b5d-bec4-739aa6e7e795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad227c7-816e-4b5d-bec4-739aa6e7e795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e6e198-530f-456f-91ca-39ee690e8020', 'volume_name': 'volume-43e6e198-530f-456f-91ca-39ee690e8020', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa2e4de-7d51-4d6b-ac3d-0273d3b90b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa2e4de-7d51-4d6b-ac3d-0273d3b90b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7c8583-25c9-4710-b256-3e901b803f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:34 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume 43e6e198-530f-456f-91ca-39ee690e8020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e6e198-530f-456f-91ca-39ee690e8020', 'volume_size': 1}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:34 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a" returned: 0 in 0.427s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-b90a3aab-e7cb-4a64-a149-4179770c141a" released by "_copy_volume_from_snapshot" :: held 4.518s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-d29cdead-7122-45a1-bc93-60a805b61803-b90a3aab-e7cb-4a64-a149-4179770c141a" released by "_create_volume_from_snapshot" :: held 4.536s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.544s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603207746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e6e198-530f-456f-91ca-39ee690e8020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:35Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Creating volume 43e6e198-530f-456f-91ca-39ee690e8020 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:34 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:34 devstack sudo[89476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020 1073741824
Apr 13 18:48:34 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf47e891-1064-45f0-9206-55eb877d023a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90a3aab-e7cb-4a64-a149-4179770c141a', 'volume_size': 1, 'snapshot_id': 'd29cdead-7122-45a1-bc93-60a805b61803'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7587cac8-e222-4619-863d-e932b9c1824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:34 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Volume volume-b90a3aab-e7cb-4a64-a149-4179770c141a (b90a3aab-e7cb-4a64-a149-4179770c141a): created successfully
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7587cac8-e222-4619-863d-e932b9c1824f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Flow 'volume_create_manager' (93300ebf-60fd-4fc4-b712-b7d2e5a3750d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:34 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ed0de766-e297-4da7-bcbc-2e962b2d0c34 tempest-VolumesSnapshotTestJSON-1020932222 None] Created volume successfully.
Apr 13 18:48:35 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020 1073741824" returned: 0 in 0.573s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:35 devstack sudo[89481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020
Apr 13 18:48:35 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-b90a3aab-e7cb-4a64-a149-4179770c141a-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-b90a3aab-e7cb-4a64-a149-4179770c141a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-b90a3aab-e7cb-4a64-a149-4179770c141a" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-b90a3aab-e7cb-4a64-a149-4179770c141a" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b0e96a-d348-4845-8cca-2748755ac523]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:35 devstack sudo[89483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a
Apr 13 18:48:35 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:35 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020" returned: 0 in 0.472s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7c8583-25c9-4710-b256-3e901b803f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e6e198-530f-456f-91ca-39ee690e8020', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab02c8f-1d9d-40ee-8b9b-b1c262b60d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:35 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume volume-43e6e198-530f-456f-91ca-39ee690e8020 (43e6e198-530f-456f-91ca-39ee690e8020): created successfully
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab02c8f-1d9d-40ee-8b9b-b1c262b60d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (a0f198e4-6c77-4139-a170-f305f84bd30c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:36 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-74322d7b-9b28-4243-9b50-da4744febfb4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created volume successfully.
Apr 13 18:48:36 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a" returned: 0 in 0.513s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:36 devstack sudo[89489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a
Apr 13 18:48:36 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:36 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-b90a3aab-e7cb-4a64-a149-4179770c141a" returned: 0 in 0.437s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-b90a3aab-e7cb-4a64-a149-4179770c141a" released by "delete_volume" :: held 0.991s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Created reservations ['ff6b4cda-d1d9-4b6d-b36b-7cf4959bb786', '573181ec-9ae4-43a2-86cb-896c73752807', '5af3f71b-2bb1-4d37-8e47-0bd53126afa2', '223cb6f2-c1a8-4597-816c-4c0291224429'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:36 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:36 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-d29cdead-7122-45a1-bc93-60a805b61803-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-d29cdead-7122-45a1-bc93-60a805b61803-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-d29cdead-7122-45a1-bc93-60a805b61803" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-d29cdead-7122-45a1-bc93-60a805b61803" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Deleting offline snapshot d29cdead-7122-45a1-bc93-60a805b61803 of volume 2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] snapshot_file for this snap is: volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00405c3-5a51-4717-98f2-471717439655]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:37 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803
Apr 13 18:48:37 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (b45b1a04-551b-41f1-aceb-9e5640f92d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ff02ea-0ee1-4b86-9f88-55493746a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ff02ea-0ee1-4b86-9f88-55493746a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118444604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff1debd-7fb7-4a50-8720-4ecbd487e777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:37Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9d9a72-8f12-44e4-b43b-7acbd56d0b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9d9a72-8f12-44e4-b43b-7acbd56d0b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d3d3e4-4f1f-4c6e-b154-875293a74adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d3d3e4-4f1f-4c6e-b154-875293a74adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff1debd-7fb7-4a50-8720-4ecbd487e777', 'volume_name': 'volume-eff1debd-7fb7-4a50-8720-4ecbd487e777', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396adb74-82c6-44c7-b997-698a7118eaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396adb74-82c6-44c7-b997-698a7118eaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebc5a0d-7d63-4a0d-934a-bf309378d61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume eff1debd-7fb7-4a50-8720-4ecbd487e777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff1debd-7fb7-4a50-8720-4ecbd487e777', 'volume_size': 1}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2118444604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff1debd-7fb7-4a50-8720-4ecbd487e777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:37Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Creating volume eff1debd-7fb7-4a50-8720-4ecbd487e777 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:37 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:37 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777 1073741824
Apr 13 18:48:37 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:37 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.548s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:37 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Deleted volume successfully.
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b39dfa84-26ca-4178-9efc-f0043636b8fe tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-b90a3aab-e7cb-4a64-a149-4179770c141a-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (3b4a1387-a76a-4be2-8778-b931d66db4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bffd493-dad0-4bc4-9fb9-61ed64f87b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bffd493-dad0-4bc4-9fb9-61ed64f87b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1245860123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886b812c-467c-4e5c-8096-fcce15b967b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:37Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f09e26-7084-4c64-8809-bcca4ed4039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f09e26-7084-4c64-8809-bcca4ed4039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24a8577-62e5-430d-9cd1-6257765c7378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24a8577-62e5-430d-9cd1-6257765c7378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '886b812c-467c-4e5c-8096-fcce15b967b6', 'volume_name': 'volume-886b812c-467c-4e5c-8096-fcce15b967b6', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d4a605-d659-46c9-88fa-bbaad99a8fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d4a605-d659-46c9-88fa-bbaad99a8fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71228b8-6f1e-454d-8fd3-ef17bdc50610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume 886b812c-467c-4e5c-8096-fcce15b967b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-886b812c-467c-4e5c-8096-fcce15b967b6', 'volume_size': 1}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (0492cded-8bf3-49c2-aae9-d6131feee8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7c5da9-ad32-42b9-8671-c3660392ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7c5da9-ad32-42b9-8671-c3660392ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1161554056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b13f764-cb93-4647-9da6-b93ada1d64e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:38Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc69267-0974-4085-87b9-28330906f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc69267-0974-4085-87b9-28330906f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cd32d9-5860-4637-a2f6-abd961df2b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cd32d9-5860-4637-a2f6-abd961df2b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b13f764-cb93-4647-9da6-b93ada1d64e5', 'volume_name': 'volume-1b13f764-cb93-4647-9da6-b93ada1d64e5', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1dbd12-c4d1-4c0b-8860-0fe3dccd47af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1dbd12-c4d1-4c0b-8860-0fe3dccd47af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99db7497-8309-4cb1-a9aa-233edc08bf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:37 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume 1b13f764-cb93-4647-9da6-b93ada1d64e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b13f764-cb93-4647-9da6-b93ada1d64e5', 'volume_size': 1}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:37 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803" returned: 0 in 0.875s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:37 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777 1073741824" returned: 0 in 0.653s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b49bf6-f92a-46eb-af04-56c836e28e89]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:37 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777
Apr 13 18:48:37 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:37 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d
Apr 13 18:48:37 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (e48fac20-6b9d-4b85-bb44-ed9ec524c057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdaa2ea2-339f-419f-ba9e-7f7cc0f85c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdaa2ea2-339f-419f-ba9e-7f7cc0f85c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1249880810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19d556a-9b3f-48d2-9788-cb98fd85f967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:38Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bf14d3-c543-4ca6-a07d-4e141e48b8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bf14d3-c543-4ca6-a07d-4e141e48b8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a0376a-a1ee-4171-84a4-92a1d5065a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a0376a-a1ee-4171-84a4-92a1d5065a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19d556a-9b3f-48d2-9788-cb98fd85f967', 'volume_name': 'volume-c19d556a-9b3f-48d2-9788-cb98fd85f967', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5e3017-e274-4535-b875-800b0d662f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5e3017-e274-4535-b875-800b0d662f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf058190-f752-4d4d-8e91-ec47a7518639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume c19d556a-9b3f-48d2-9788-cb98fd85f967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19d556a-9b3f-48d2-9788-cb98fd85f967', 'volume_size': 1}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (78bdea5c-b9b6-4492-b466-68d90fae348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a04a42-0875-4526-8d95-08226e5542d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a04a42-0875-4526-8d95-08226e5542d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845855042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430c741f-f401-4359-94b3-9161e7467b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:38Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86627bc1-64d3-4b68-998b-a97218454f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86627bc1-64d3-4b68-998b-a97218454f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc52a68-9c87-4698-8596-4c8d7957e331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc52a68-9c87-4698-8596-4c8d7957e331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430c741f-f401-4359-94b3-9161e7467b5c', 'volume_name': 'volume-430c741f-f401-4359-94b3-9161e7467b5c', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a8314a-6fb3-4c69-97fa-3ae90a88ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a8314a-6fb3-4c69-97fa-3ae90a88ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee6f60c-411f-4478-9de7-e811ee2a1757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume 430c741f-f401-4359-94b3-9161e7467b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430c741f-f401-4359-94b3-9161e7467b5c', 'volume_size': 1}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:38 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777" returned: 0 in 0.551s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1245860123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886b812c-467c-4e5c-8096-fcce15b967b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:37Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Creating volume 886b812c-467c-4e5c-8096-fcce15b967b6 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:38 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:38 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebc5a0d-7d63-4a0d-934a-bf309378d61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff1debd-7fb7-4a50-8720-4ecbd487e777', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f29d0f-7e86-489a-a1fd-a1e138cd8b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" returned: 0 in 0.613s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:38 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6 1073741824
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:38 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:38 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume volume-eff1debd-7fb7-4a50-8720-4ecbd487e777 (eff1debd-7fb7-4a50-8720-4ecbd487e777): created successfully
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f29d0f-7e86-489a-a1fd-a1e138cd8b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:38 devstack sudo[89515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803
Apr 13 18:48:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (b45b1a04-551b-41f1-aceb-9e5640f92d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:38 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:38 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-cfbc9f23-637d-457e-a7cd-d034b75f2f13 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created volume successfully.
Apr 13 18:48:39 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803" returned: 0 in 0.529s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:39 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6 1073741824" returned: 0 in 0.570s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:39 devstack sudo[89523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803
Apr 13 18:48:39 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:39 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6
Apr 13 18:48:39 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:39 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d.d29cdead-7122-45a1-bc93-60a805b61803" returned: 0 in 0.479s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-d29cdead-7122-45a1-bc93-60a805b61803" released by "_delete_snapshot" :: held 2.576s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" released by "delete_snapshot" :: held 2.592s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:39 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6" returned: 0 in 0.500s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1161554056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b13f764-cb93-4647-9da6-b93ada1d64e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:38Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Creating volume 1b13f764-cb93-4647-9da6-b93ada1d64e5 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:39 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:39 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5 1073741824
Apr 13 18:48:39 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71228b8-6f1e-454d-8fd3-ef17bdc50610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886b812c-467c-4e5c-8096-fcce15b967b6', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db20aaf-6037-415b-be27-40862d099a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:39 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume volume-886b812c-467c-4e5c-8096-fcce15b967b6 (886b812c-467c-4e5c-8096-fcce15b967b6): created successfully
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db20aaf-6037-415b-be27-40862d099a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (3b4a1387-a76a-4be2-8778-b931d66db4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Created reservations ['608440c7-3527-463e-b625-704f951aed3b', '39acba74-994a-445d-9454-19e87d806ec1', '6fb40f68-c01c-441d-9bcf-ab6c1e77ac3d', '52e20e9b-5662-43b8-9a85-8a78d5713da6'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:39 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-139b3979-d79b-4333-b000-4d60b57a4968 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created volume successfully.
Apr 13 18:48:39 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Delete snapshot completed successfully.
Apr 13 18:48:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c755a0e3-81cf-475e-bf76-7f91b7129ea0 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-d29cdead-7122-45a1-bc93-60a805b61803-delete_snapshot" released by "delete_snapshot" :: held 2.736s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:40 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5 1073741824" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:40 devstack sudo[89534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5
Apr 13 18:48:40 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f0eaa0-eea6-419e-ac34-e4ea6c67ff41]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:40 devstack sudo[89536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d
Apr 13 18:48:40 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:40 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5" returned: 0 in 0.482s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1249880810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19d556a-9b3f-48d2-9788-cb98fd85f967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:38Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Creating volume c19d556a-9b3f-48d2-9788-cb98fd85f967 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:40 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99db7497-8309-4cb1-a9aa-233edc08bf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b13f764-cb93-4647-9da6-b93ada1d64e5', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3357450-8980-4497-96ee-c7dc9b0685ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:40 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967 1073741824
Apr 13 18:48:40 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:40 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume volume-1b13f764-cb93-4647-9da6-b93ada1d64e5 (1b13f764-cb93-4647-9da6-b93ada1d64e5): created successfully
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3357450-8980-4497-96ee-c7dc9b0685ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (0492cded-8bf3-49c2-aae9-d6131feee8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:40 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-aec63bd7-af11-4997-9f80-0520e62851e6 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created volume successfully.
Apr 13 18:48:40 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" returned: 0 in 0.541s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:40 devstack sudo[89544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d
Apr 13 18:48:40 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Flow 'volume_create_manager' (2b471256-0ef6-48f7-af37-92c143d13994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e688a4-a4b0-4b92-ad62-56975b42fd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e688a4-a4b0-4b92-ad62-56975b42fd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1917981057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9fc85d-d702-4677-9982-67bc0570d193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed451498eb7847c087273e483ea574af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:41Z,use_quota=True,user_id='a6001444478d418792bd2792c4436eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac4f41f-b942-40cb-99e8-159ef82a9811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac4f41f-b942-40cb-99e8-159ef82a9811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b39357-f11c-4f8b-b9df-ed33ce2676eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b39357-f11c-4f8b-b9df-ed33ce2676eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9fc85d-d702-4677-9982-67bc0570d193', 'volume_name': 'volume-bc9fc85d-d702-4677-9982-67bc0570d193', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af40c9f9-9f66-44cc-b188-09a4555e4703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af40c9f9-9f66-44cc-b188-09a4555e4703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030381a1-928b-4b06-b944-d9689af40b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:40 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Volume bc9fc85d-d702-4677-9982-67bc0570d193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9fc85d-d702-4677-9982-67bc0570d193', 'volume_size': 1}
Apr 13 18:48:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:41 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967 1073741824" returned: 0 in 0.474s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:41 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967
Apr 13 18:48:41 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:41 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" returned: 0 in 0.426s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d" released by "delete_volume" :: held 0.999s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Created reservations ['83875d87-ad23-46e4-a778-b8bbdf232015', 'ed36402f-52d1-4fa0-b07d-96ae3f42caa9', 'd3b0890d-1b48-41d9-93c0-1b3139bf9aa9', '712290db-bd53-4418-9007-d8391edb20e6'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:41 devstack sudo[89552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:41 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:41 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967" returned: 0 in 0.422s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.092s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845855042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430c741f-f401-4359-94b3-9161e7467b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137189b028ca46bdbf60309c023e569d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:38Z,use_quota=True,user_id='e18646dc7d5f44288062ceabc5efb9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Creating volume 430c741f-f401-4359-94b3-9161e7467b5c {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:41 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf058190-f752-4d4d-8e91-ec47a7518639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19d556a-9b3f-48d2-9788-cb98fd85f967', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:41 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c 1073741824
Apr 13 18:48:41 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23587e56-acf6-4474-bc8e-88fd5b68eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:41 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume volume-c19d556a-9b3f-48d2-9788-cb98fd85f967 (c19d556a-9b3f-48d2-9788-cb98fd85f967): created successfully
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23587e56-acf6-4474-bc8e-88fd5b68eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (e48fac20-6b9d-4b85-bb44-ed9ec524c057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:41 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-47644f5e-2ae2-4706-8aa6-c726ac8d592f tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created volume successfully.
Apr 13 18:48:41 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.418s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:41 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Deleted volume successfully.
Apr 13 18:48:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c9bb29d3-c13c-4412-9be4-d1d690bb8d33 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-2f4fe0c7-9eb5-4692-aa95-c837ec25cc4d-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:42 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c 1073741824" returned: 0 in 0.481s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:42 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c
Apr 13 18:48:42 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-f4e7e570-3050-4720-8f49-11ed4cb89120-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-f4e7e570-3050-4720-8f49-11ed4cb89120-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "cinder-quobyte-f4e7e570-3050-4720-8f49-11ed4cb89120" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-f4e7e570-3050-4720-8f49-11ed4cb89120" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[af693bf2-b43a-4931-adbb-133ef6e460fa]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:42 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c" returned: 0 in 0.462s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1917981057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9fc85d-d702-4677-9982-67bc0570d193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed451498eb7847c087273e483ea574af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:41Z,use_quota=True,user_id='a6001444478d418792bd2792c4436eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Creating volume bc9fc85d-d702-4677-9982-67bc0570d193 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:42 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee6f60c-411f-4478-9de7-e811ee2a1757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430c741f-f401-4359-94b3-9161e7467b5c', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:42 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120
Apr 13 18:48:42 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:42 devstack sudo[89565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193 1073741824
Apr 13 18:48:42 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343d24f-5431-48a1-8d58-69a8840c2435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:42 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Volume volume-430c741f-f401-4359-94b3-9161e7467b5c (430c741f-f401-4359-94b3-9161e7467b5c): created successfully
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343d24f-5431-48a1-8d58-69a8840c2435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Flow 'volume_create_manager' (78bdea5c-b9b6-4492-b466-68d90fae348f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:42 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-73f3a2d5-aa42-4647-9ef4-90fa7d8b640d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created volume successfully.
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-430c741f-f401-4359-94b3-9161e7467b5c-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-430c741f-f401-4359-94b3-9161e7467b5c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-quobyte-430c741f-f401-4359-94b3-9161e7467b5c" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-430c741f-f401-4359-94b3-9161e7467b5c" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5472760-fffa-4fca-b7f3-aa406bae37be]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:42 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c
Apr 13 18:48:42 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:42 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120" returned: 0 in 0.516s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:43 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:43 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120
Apr 13 18:48:43 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193 1073741824" returned: 0 in 0.494s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:43 devstack sudo[89578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193
Apr 13 18:48:43 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:43 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:43 devstack sudo[89584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c
Apr 13 18:48:43 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:43 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f4e7e570-3050-4720-8f49-11ed4cb89120" returned: 0 in 0.443s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-quobyte-f4e7e570-3050-4720-8f49-11ed4cb89120" released by "delete_volume" :: held 0.986s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:43 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193" returned: 0 in 0.443s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030381a1-928b-4b06-b944-d9689af40b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9fc85d-d702-4677-9982-67bc0570d193', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380edc15-7ef8-49fe-8de6-a333dd9f9ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:43 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Volume volume-bc9fc85d-d702-4677-9982-67bc0570d193 (bc9fc85d-d702-4677-9982-67bc0570d193): created successfully
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380edc15-7ef8-49fe-8de6-a333dd9f9ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Flow 'volume_create_manager' (2b471256-0ef6-48f7-af37-92c143d13994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Created reservations ['53041ba1-2d95-4b6c-92d2-8f90f542a4e2', '998291e7-a726-4e03-8778-aa937bd89839', 'a7bec708-faa1-4e4c-a099-12e45c84617a', 'ffc7c006-502b-4a2f-b71f-b307928206bb'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:43 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f75ca0f7-47da-4131-8e87-cf4df31497e3 tempest-AbsoluteLimitsTests-596334782 None] Created volume successfully.
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:43 devstack sudo[89588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:43 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:43 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-430c741f-f401-4359-94b3-9161e7467b5c" returned: 0 in 0.431s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-430c741f-f401-4359-94b3-9161e7467b5c" released by "delete_volume" :: held 0.944s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created reservations ['0ca2f094-7aed-468e-bbf9-ab9fd9d00594', '216b5a49-5cee-4e42-bab8-deb3921e9edb', '6d3fed37-1c9e-4d86-973c-c71c2f60bb93', 'a1a558e3-13fc-4c22-835a-5126ebd2a57d'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:43 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:43 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-c19d556a-9b3f-48d2-9788-cb98fd85f967-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-c19d556a-9b3f-48d2-9788-cb98fd85f967-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-quobyte-c19d556a-9b3f-48d2-9788-cb98fd85f967" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-c19d556a-9b3f-48d2-9788-cb98fd85f967" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbf5e9c-cb13-4422-8bb4-199979d0ff8c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:44 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.444s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:44 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Deleted volume successfully.
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-99f4180a-9eb2-4747-bdd3-1135a3088b06 tempest-VolumesSnapshotTestJSON-1020932222 None] Lock "cinder-f4e7e570-3050-4720-8f49-11ed4cb89120-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:44 devstack sudo[89594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967
Apr 13 18:48:44 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Acquiring lock "cinder-bc9fc85d-d702-4677-9982-67bc0570d193-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Lock "cinder-bc9fc85d-d702-4677-9982-67bc0570d193-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Acquiring lock "cinder-quobyte-bc9fc85d-d702-4677-9982-67bc0570d193" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Lock "cinder-quobyte-bc9fc85d-d702-4677-9982-67bc0570d193" acquired by "delete_volume" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe1be8-3ed0-42b9-86ee-48744f31c6d3]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:44 devstack sudo[89596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193
Apr 13 18:48:44 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:44 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.437s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:44 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Deleted volume successfully.
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-8bd32980-46cf-4953-b954-bcccaac5c2ad tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-430c741f-f401-4359-94b3-9161e7467b5c-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:44 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967" returned: 0 in 0.538s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:44 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967
Apr 13 18:48:44 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:44 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:44 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193
Apr 13 18:48:44 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:44 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c19d556a-9b3f-48d2-9788-cb98fd85f967" returned: 0 in 0.476s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-c19d556a-9b3f-48d2-9788-cb98fd85f967" released by "delete_volume" :: held 1.038s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created reservations ['2081f846-a359-4873-8aeb-0ab5d4f70b54', 'f9635882-7531-436e-be9b-8126b344e593', '5bcf735a-0140-4192-95a3-6e202ab69480', '5b343026-fd3b-407c-8c7c-2b444ddd4dda'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:45 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:45 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:45 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bc9fc85d-d702-4677-9982-67bc0570d193" returned: 0 in 0.466s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Lock "cinder-quobyte-bc9fc85d-d702-4677-9982-67bc0570d193" released by "delete_volume" :: held 0.975s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Created reservations ['36ffae96-2579-4a37-ad0f-ddac33f041d4', '08d2d7a9-3e9d-4d15-8338-0048ebeb23b4', '7fbbab83-5c2c-4e77-b955-b9a0a8269bfe', 'cd3d6339-2eef-443e-8acc-c31bf588bb3e'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:45 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:45 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:45 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.469s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:45 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Deleted volume successfully.
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-582e21d2-d0b5-48d7-9f42-65467e4d788d tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-c19d556a-9b3f-48d2-9788-cb98fd85f967-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:45 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.451s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:45 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Deleted volume successfully.
Apr 13 18:48:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-34e28f21-1c10-4237-9648-e200a3e1dce3 tempest-AbsoluteLimitsTests-596334782 None] Lock "cinder-bc9fc85d-d702-4677-9982-67bc0570d193-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-1b13f764-cb93-4647-9da6-b93ada1d64e5-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-1b13f764-cb93-4647-9da6-b93ada1d64e5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-quobyte-1b13f764-cb93-4647-9da6-b93ada1d64e5" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-1b13f764-cb93-4647-9da6-b93ada1d64e5" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:46 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[765750d8-0411-4bb5-8c7d-172a143bfa22]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:46 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5
Apr 13 18:48:46 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:46 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5" returned: 0 in 0.539s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:46 devstack sudo[89623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5
Apr 13 18:48:46 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:47 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1b13f764-cb93-4647-9da6-b93ada1d64e5" returned: 0 in 0.509s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-1b13f764-cb93-4647-9da6-b93ada1d64e5" released by "delete_volume" :: held 1.082s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created reservations ['4ee6d478-c204-45ba-b8be-1e45a67690c0', 'a3dca0a5-ad0a-41a9-9109-9cca3db02fde', 'ecb572cc-098e-4db3-9228-d92e04edaeb1', 'ec40a37f-5a90-47bc-a501-1a0fd1ded49c'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:47 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:47 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:47 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.526s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:47 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Deleted volume successfully.
Apr 13 18:48:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4f4b7106-9bcb-4c40-b0aa-f2f503017ae4 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-1b13f764-cb93-4647-9da6-b93ada1d64e5-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-886b812c-467c-4e5c-8096-fcce15b967b6-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-886b812c-467c-4e5c-8096-fcce15b967b6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-quobyte-886b812c-467c-4e5c-8096-fcce15b967b6" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-886b812c-467c-4e5c-8096-fcce15b967b6" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78d59e6-f05c-4e0f-abf2-26f9b874653e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:48 devstack sudo[89632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6
Apr 13 18:48:48 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Flow 'volume_create_manager' (ee4c70b5-2d6a-4b81-b824-2841476ab2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0867e48-0560-42c6-8ed4-e6e2eb6e44ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0867e48-0560-42c6-8ed4-e6e2eb6e44ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339917a9-49c8-4ec7-86ad-706a3e3b2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6937a4981fad4264b564ba6ef5fe6a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:49Z,use_quota=True,user_id='6a78c64fade94f5ca84673d6b8755b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ce3dc3-e3bf-4a61-8be6-ad1075719fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ce3dc3-e3bf-4a61-8be6-ad1075719fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c892b7df-6d37-4930-96da-e6b1589340a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c892b7df-6d37-4930-96da-e6b1589340a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '339917a9-49c8-4ec7-86ad-706a3e3b2af9', 'volume_name': 'volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e48a8b-3fb4-4a37-b322-3cafe2e97995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e48a8b-3fb4-4a37-b322-3cafe2e97995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afee21ba-dd99-4a86-959a-09a134e9e131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:48 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Volume 339917a9-49c8-4ec7-86ad-706a3e3b2af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9', 'volume_size': 1}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=339917a9-49c8-4ec7-86ad-706a3e3b2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6937a4981fad4264b564ba6ef5fe6a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:49Z,use_quota=True,user_id='6a78c64fade94f5ca84673d6b8755b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Creating volume 339917a9-49c8-4ec7-86ad-706a3e3b2af9 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:48 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:48 devstack sudo[89637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9 1073741824
Apr 13 18:48:48 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:49 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6" returned: 0 in 0.627s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:49 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6
Apr 13 18:48:49 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Flow 'volume_create_manager' (dc720fcc-15c1-446b-8456-6adfae566ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fc028c-8282-4be0-a8dd-9f90f1e4b40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fc028c-8282-4be0-a8dd-9f90f1e4b40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-178775697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79255427-41fb-4c12-8a0f-1765ab0c5dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a1530729004c13abe3c21188cbd776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:49Z,use_quota=True,user_id='a9378ab7bde8470fb54a3376b911ef16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6129aa-2fb0-4bb2-aca9-ef8af3843fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6129aa-2fb0-4bb2-aca9-ef8af3843fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c646c8-7482-4075-af6c-f3f06d0cd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c646c8-7482-4075-af6c-f3f06d0cd041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79255427-41fb-4c12-8a0f-1765ab0c5dfe', 'volume_name': 'volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8bcf5c-6a68-47f9-af25-63387c418fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8bcf5c-6a68-47f9-af25-63387c418fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234fcee3-00f3-41f0-a85b-d30b2408803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:49 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Volume 79255427-41fb-4c12-8a0f-1765ab0c5dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe', 'volume_size': 1}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:49 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-886b812c-467c-4e5c-8096-fcce15b967b6" returned: 0 in 0.430s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-886b812c-467c-4e5c-8096-fcce15b967b6" released by "delete_volume" :: held 1.079s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:49 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9 1073741824" returned: 0 in 0.538s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created reservations ['e1539eb2-d8c2-490f-8aa0-725aa580dd32', '081f6fd7-0941-44e4-ae94-bb54e582ac45', '79d4bc35-ae1e-4e9b-beeb-11be5a1479c2', '75d62fd8-033e-4d89-80dc-952f38655f32'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:49 devstack sudo[89645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9
Apr 13 18:48:49 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:49 devstack sudo[89647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:49 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:49 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9" returned: 0 in 0.415s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.817s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-178775697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79255427-41fb-4c12-8a0f-1765ab0c5dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a1530729004c13abe3c21188cbd776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:49Z,use_quota=True,user_id='a9378ab7bde8470fb54a3376b911ef16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Creating volume 79255427-41fb-4c12-8a0f-1765ab0c5dfe {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:49 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:49 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afee21ba-dd99-4a86-959a-09a134e9e131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fdeb86-8e22-44d8-a245-b5f495ee3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:49 devstack sudo[89651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe 1073741824
Apr 13 18:48:49 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.418s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Deleted volume successfully.
Apr 13 18:48:49 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Volume volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9 (339917a9-49c8-4ec7-86ad-706a3e3b2af9): created successfully
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fdeb86-8e22-44d8-a245-b5f495ee3e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:49 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Flow 'volume_create_manager' (ee4c70b5-2d6a-4b81-b824-2841476ab2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5027a702-2162-489c-9c17-602fe099c0bd tempest-CinderUnicodeTest-741526917 None] Created volume successfully.
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9971fd03-e97f-428f-85b7-f7cb71c950c8 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-886b812c-467c-4e5c-8096-fcce15b967b6-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:50 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe 1073741824" returned: 0 in 0.472s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:50 devstack sudo[89656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe
Apr 13 18:48:50 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-eff1debd-7fb7-4a50-8720-4ecbd487e777-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-eff1debd-7fb7-4a50-8720-4ecbd487e777-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-quobyte-eff1debd-7fb7-4a50-8720-4ecbd487e777" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-eff1debd-7fb7-4a50-8720-4ecbd487e777" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[88894178-da11-4946-bd40-6af728ee910a]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:50 devstack sudo[89658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777
Apr 13 18:48:50 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:50 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe" returned: 0 in 0.421s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234fcee3-00f3-41f0-a85b-d30b2408803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db11629d-5887-48da-9539-e958999f2b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:50 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Volume volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe (79255427-41fb-4c12-8a0f-1765ab0c5dfe): created successfully
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db11629d-5887-48da-9539-e958999f2b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:50 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Flow 'volume_create_manager' (dc720fcc-15c1-446b-8456-6adfae566ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:50 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-cd74bc20-06b9-428b-8343-cb82852f3717 tempest-VolumesMetadataTest-112870869 None] Created volume successfully.
Apr 13 18:48:51 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777" returned: 0 in 0.506s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:51 devstack sudo[89664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777
Apr 13 18:48:51 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Flow 'volume_create_manager' (d4146406-08cf-4a23-9c0c-f32f62bef5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b81fb0-7b81-40dd-9935-4aab4d7bca10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b81fb0-7b81-40dd-9935-4aab4d7bca10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-392126571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31885759-03dc-403a-97e0-a214f92c3601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6937a4981fad4264b564ba6ef5fe6a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:51Z,use_quota=True,user_id='6a78c64fade94f5ca84673d6b8755b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7500365d-c5d5-44ef-bbda-a672b7ebc4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7500365d-c5d5-44ef-bbda-a672b7ebc4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b78b17-2cae-4725-ada2-9f672805416b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b78b17-2cae-4725-ada2-9f672805416b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31885759-03dc-403a-97e0-a214f92c3601', 'volume_name': 'volume-31885759-03dc-403a-97e0-a214f92c3601', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16d3a81-b1e3-4a3f-a356-0ec7eb45c011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16d3a81-b1e3-4a3f-a356-0ec7eb45c011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4b82ad-e1be-4230-87bf-3320e7dbc2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:51 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Volume 31885759-03dc-403a-97e0-a214f92c3601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31885759-03dc-403a-97e0-a214f92c3601', 'volume_size': 1}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-392126571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31885759-03dc-403a-97e0-a214f92c3601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6937a4981fad4264b564ba6ef5fe6a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:51Z,use_quota=True,user_id='6a78c64fade94f5ca84673d6b8755b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Creating volume 31885759-03dc-403a-97e0-a214f92c3601 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:51 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:51 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601 1073741824
Apr 13 18:48:51 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:51 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-eff1debd-7fb7-4a50-8720-4ecbd487e777" returned: 0 in 0.442s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-eff1debd-7fb7-4a50-8720-4ecbd487e777" released by "delete_volume" :: held 0.982s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created reservations ['d3b171cb-0859-4e24-8415-de4c1fab5015', '543bf0b7-0178-41a2-baf3-d187c45815e5', 'c3124285-3241-4186-9849-97ad75c9ae9b', '5fed226e-1ce8-4ec6-8dd4-dacc65da62b0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-43e6e198-530f-456f-91ca-39ee690e8020-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:51 devstack sudo[89669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:51 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-43e6e198-530f-456f-91ca-39ee690e8020-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "cinder-quobyte-43e6e198-530f-456f-91ca-39ee690e8020" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-43e6e198-530f-456f-91ca-39ee690e8020" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a8c85e-1bc8-412e-8b62-920b38679205]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Acquiring lock "cinder-79255427-41fb-4c12-8a0f-1765ab0c5dfe-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Lock "cinder-79255427-41fb-4c12-8a0f-1765ab0c5dfe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Acquiring lock "cinder-quobyte-79255427-41fb-4c12-8a0f-1765ab0c5dfe" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Lock "cinder-quobyte-79255427-41fb-4c12-8a0f-1765ab0c5dfe" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5877cac-af71-424a-ac46-45eb9161f31a]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:51 devstack sudo[89674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020
Apr 13 18:48:51 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:51 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601 1073741824" returned: 0 in 0.534s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:51 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601
Apr 13 18:48:51 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:51 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe
Apr 13 18:48:51 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:52 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:52 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Deleted volume successfully.
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7a2ec017-f2cf-4bc2-a569-2b7b7a10d6ec tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-eff1debd-7fb7-4a50-8720-4ecbd487e777-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:52 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020" returned: 0 in 0.541s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:52 devstack sudo[89688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020
Apr 13 18:48:52 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:52 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601" returned: 0 in 0.433s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4b82ad-e1be-4230-87bf-3320e7dbc2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31885759-03dc-403a-97e0-a214f92c3601', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6fc0ae-7be3-42b5-81ba-63b2961d6186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:52 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe" returned: 0 in 0.506s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:52 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Volume volume-31885759-03dc-403a-97e0-a214f92c3601 (31885759-03dc-403a-97e0-a214f92c3601): created successfully
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6fc0ae-7be3-42b5-81ba-63b2961d6186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:52 devstack sudo[89690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe
Apr 13 18:48:52 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Flow 'volume_create_manager' (d4146406-08cf-4a23-9c0c-f32f62bef5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:52 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3b7619fe-0050-4b75-a8e7-d0489f6df0de tempest-CinderUnicodeTest-741526917 None] Created volume successfully.
Apr 13 18:48:52 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-43e6e198-530f-456f-91ca-39ee690e8020" returned: 0 in 0.419s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-quobyte-43e6e198-530f-456f-91ca-39ee690e8020" released by "delete_volume" :: held 0.986s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:52 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-79255427-41fb-4c12-8a0f-1765ab0c5dfe" returned: 0 in 0.392s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Created reservations ['4de2cb2c-7b40-4d50-94d9-c4c6a930a9ee', '3a64b606-a4e2-4699-82d7-d13d8d130c9d', 'ae7677a5-e9f9-4662-9a49-03d6d2a8332e', 'd723bd06-32de-466b-be82-c574c2b5eaa6'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Lock "cinder-quobyte-79255427-41fb-4c12-8a0f-1765ab0c5dfe" released by "delete_volume" :: held 0.920s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Created reservations ['86e8d7d4-d7d4-436f-bd16-480c5fdac9b3', '3309d25f-c134-4650-9392-5ceb757e603b', '4920fca9-ead6-4496-9e0e-90543c4c74f0', 'b0183c09-25d8-4820-a434-601e661ca570'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:52 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:52 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:52 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:52 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:53 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.458s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Deleted volume successfully.
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-fb7c3520-040a-4b43-a6d0-60d93cb48d02 tempest-CreateVolumesFromSourceVolumeTest-305576122 None] Lock "cinder-43e6e198-530f-456f-91ca-39ee690e8020-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:53 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:48:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Deleted volume successfully.
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-5fc043b9-2544-4b67-b1aa-353f447dc946 tempest-VolumesMetadataTest-112870869 None] Lock "cinder-79255427-41fb-4c12-8a0f-1765ab0c5dfe-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Creating offline snapshot 0077ff6a-9791-4d46-afdc-f7e7c0231303 of volume 31885759-03dc-403a-97e0-a214f92c3601 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd762e70-520c-4f88-b8ea-865cd2bef723]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:53 devstack sudo[89700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601
Apr 13 18:48:53 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:54 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:54 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 1G
Apr 13 18:48:54 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:54 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 1G" returned: 0 in 0.559s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31885759-03dc-403a-97e0-a214f92c3601 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:54 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31885759-03dc-403a-97e0-a214f92c3601 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303
Apr 13 18:48:54 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:55 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31885759-03dc-403a-97e0-a214f92c3601 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:55 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 is being set with open permissions: ugo+rw
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:55 devstack sudo[89716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303
Apr 13 18:48:55 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:55 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303" returned: 0 in 0.396s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=228,cinder:INSERT=75,cinder:UPDATE=301,cinder:DELETE=23 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=220,cinder:INSERT=81,cinder:UPDATE=284,cinder:DELETE=26 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:55 devstack sudo[89719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.info
Apr 13 18:48:55 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Flow 'volume_create_manager' (6324475b-bedc-41ba-bf89-f8528968791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be57964-7205-426d-a5bf-863e8bbeb222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be57964-7205-426d-a5bf-863e8bbeb222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-92810143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d27cc5f-fd73-4cbd-b72d-a675e423c9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3a3c07cfb545cc99e8a81ef0e1a6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:56Z,use_quota=True,user_id='0ce0c5db98f54fc5949c8bc07176613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7b6a9e-f958-4e9d-9643-31305a80783c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7b6a9e-f958-4e9d-9643-31305a80783c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff92e102-489a-4c55-9485-38e0c5e1f433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff92e102-489a-4c55-9485-38e0c5e1f433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d27cc5f-fd73-4cbd-b72d-a675e423c9c2', 'volume_name': 'volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedbff76-d192-45e1-a44a-64857812ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedbff76-d192-45e1-a44a-64857812ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57529e1-4dda-47be-8a49-b2f6cc96455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:55 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Volume 0d27cc5f-fd73-4cbd-b72d-a675e423c9c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2', 'volume_size': 1}
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:55 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.info" returned: 0 in 0.400s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:55 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.info is being set with open permissions: ugo+rw
Apr 13 18:48:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:55 devstack sudo[89722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.info
Apr 13 18:48:55 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:56 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.info" returned: 0 in 0.410s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.832s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-92810143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d27cc5f-fd73-4cbd-b72d-a675e423c9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3a3c07cfb545cc99e8a81ef0e1a6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:48:56Z,use_quota=True,user_id='0ce0c5db98f54fc5949c8bc07176613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Creating volume 0d27cc5f-fd73-4cbd-b72d-a675e423c9c2 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:48:56 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:56 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2 1073741824
Apr 13 18:48:56 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d674f2a3-9630-4258-b925-78e454052fcb tempest-CinderUnicodeTest-741526917 None] Create snapshot completed successfully
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Acquiring lock "cinder-0077ff6a-9791-4d46-afdc-f7e7c0231303-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Lock "cinder-0077ff6a-9791-4d46-afdc-f7e7c0231303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Acquiring lock "cinder-quobyte-31885759-03dc-403a-97e0-a214f92c3601" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Lock "cinder-quobyte-31885759-03dc-403a-97e0-a214f92c3601" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Acquiring lock "cinder-quobyte-0077ff6a-9791-4d46-afdc-f7e7c0231303" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Lock "cinder-quobyte-0077ff6a-9791-4d46-afdc-f7e7c0231303" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Deleting offline snapshot 0077ff6a-9791-4d46-afdc-f7e7c0231303 of volume 31885759-03dc-403a-97e0-a214f92c3601 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] snapshot_file for this snap is: volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[70034879-b29c-4103-b1e6-8e59f5e4a2d4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:56 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303
Apr 13 18:48:56 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:56 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2 1073741824" returned: 0 in 0.497s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:56 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2
Apr 13 18:48:56 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:57 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31885759-03dc-403a-97e0-a214f92c3601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4c294-cd8d-4ece-b914-002d39a6e4fe]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:57 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601
Apr 13 18:48:57 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:57 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2" returned: 0 in 0.417s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57529e1-4dda-47be-8a49-b2f6cc96455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a71c96-2422-4e35-a00c-c539567e259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:48:57 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Volume volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2 (0d27cc5f-fd73-4cbd-b72d-a675e423c9c2): created successfully
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a71c96-2422-4e35-a00c-c539567e259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Flow 'volume_create_manager' (6324475b-bedc-41ba-bf89-f8528968791a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:48:57 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a3f127dd-d7e7-4254-80ee-2d6ad60d4fdb tempest-VolumesTransfersTest-827247012 None] Created volume successfully.
Apr 13 18:48:57 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601" returned: 0 in 0.495s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:57 devstack sudo[89743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303
Apr 13 18:48:57 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:58 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-eaf8b25e-5069-4957-82d6-05c3fb3207e6 tempest-VolumesTransfersTest-1274625251 None] Transfer volume completed successfully.
Apr 13 18:48:58 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303" returned: 0 in 0.475s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:58 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303
Apr 13 18:48:58 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:58 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601.0077ff6a-9791-4d46-afdc-f7e7c0231303" returned: 0 in 0.388s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Lock "cinder-quobyte-0077ff6a-9791-4d46-afdc-f7e7c0231303" released by "_delete_snapshot" :: held 1.907s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Lock "cinder-quobyte-31885759-03dc-403a-97e0-a214f92c3601" released by "delete_snapshot" :: held 1.919s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Created reservations ['830fb40d-9f42-4f03-a113-5d20bf921680', 'd6f0d612-798a-435a-b24b-8e4c04e1d58c', 'f91f7291-0393-4d95-9d92-5ab1d73b78e2', 'c3197b82-5d55-45af-b1a6-fa2dd8950a0e'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:58 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Delete snapshot completed successfully.
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-91ed2fcf-6c07-41a5-a9e8-a8339ffae987 tempest-CinderUnicodeTest-741526917 None] Lock "cinder-0077ff6a-9791-4d46-afdc-f7e7c0231303-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Acquiring lock "cinder-31885759-03dc-403a-97e0-a214f92c3601-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Lock "cinder-31885759-03dc-403a-97e0-a214f92c3601-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Acquiring lock "cinder-quobyte-31885759-03dc-403a-97e0-a214f92c3601" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Lock "cinder-quobyte-31885759-03dc-403a-97e0-a214f92c3601" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8431ea7-de64-455a-b595-ed23909276bc]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Acquiring lock "cinder-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Lock "cinder-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:58 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601
Apr 13 18:48:58 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Acquiring lock "cinder-quobyte-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Lock "cinder-quobyte-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2" acquired by "delete_volume" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[83772a33-a6ca-4e0d-bccf-7a768da10b6d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:59 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2
Apr 13 18:48:59 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:59 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:59 devstack sudo[89758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601
Apr 13 18:48:59 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:59 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2" returned: 0 in 0.484s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:59 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2
Apr 13 18:48:59 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:59 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-31885759-03dc-403a-97e0-a214f92c3601" returned: 0 in 0.418s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Lock "cinder-quobyte-31885759-03dc-403a-97e0-a214f92c3601" released by "delete_volume" :: held 0.939s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Created reservations ['f08bd63d-5fab-464f-b752-f450499aed26', 'd8bc03e9-6e3d-4c40-9802-05db9e4475fb', '6708ec15-30a7-4700-b68e-f5ab68444015', 'f2bcf32c-0350-4598-99ee-75b89246161a'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:59 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2" returned: 0 in 0.414s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Lock "cinder-quobyte-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2" released by "delete_volume" :: held 0.924s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:48:59 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:59 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Created reservations ['9a29a8d9-c3af-4737-9b09-85e0d74e1b2f', '817339e3-0ef2-44ee-a370-ce91e2c4e01c', 'a11375de-7b94-401c-9cca-c886a3ca3544', '26d89afa-5c3c-434e-8b44-f8b82c3b1211'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Acquiring lock "cinder-339917a9-49c8-4ec7-86ad-706a3e3b2af9-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Lock "cinder-339917a9-49c8-4ec7-86ad-706a3e3b2af9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Acquiring lock "cinder-quobyte-339917a9-49c8-4ec7-86ad-706a3e3b2af9" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:48:59 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:48:59 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Lock "cinder-quobyte-339917a9-49c8-4ec7-86ad-706a3e3b2af9" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f4b424-7232-4b6e-8475-57c7093af5f3]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:48:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:00 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9
Apr 13 18:49:00 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:00 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Flow 'volume_create_manager' (accb95b6-0cd9-4480-96f1-3c24c927fa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d50b603-1cf8-4d3f-bcc2-141362a4d440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.511s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d50b603-1cf8-4d3f-bcc2-141362a4d440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-829393267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4618cc-2673-40d7-9594-0d15b43db336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3a3c07cfb545cc99e8a81ef0e1a6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:00Z,use_quota=True,user_id='0ce0c5db98f54fc5949c8bc07176613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1eaabd-035c-4463-9e2f-113617553e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1eaabd-035c-4463-9e2f-113617553e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4aaa12c-4542-465f-8b04-6bd033eb20aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4aaa12c-4542-465f-8b04-6bd033eb20aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4618cc-2673-40d7-9594-0d15b43db336', 'volume_name': 'volume-cd4618cc-2673-40d7-9594-0d15b43db336', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a294dc-8d58-4f3b-872e-bece833bbc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a294dc-8d58-4f3b-872e-bece833bbc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777925ab-71b6-4cc6-a3ae-b15f36af8908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:00 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Volume cd4618cc-2673-40d7-9594-0d15b43db336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4618cc-2673-40d7-9594-0d15b43db336', 'volume_size': 1}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-829393267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4618cc-2673-40d7-9594-0d15b43db336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3a3c07cfb545cc99e8a81ef0e1a6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:00Z,use_quota=True,user_id='0ce0c5db98f54fc5949c8bc07176613e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Creating volume cd4618cc-2673-40d7-9594-0d15b43db336 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:00 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:00 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:00 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Deleted volume successfully.
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.453s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:00 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336 1073741824
Apr 13 18:49:00 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:00 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Deleted volume successfully.
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7f04c81-a3b3-4d93-97d3-f317e3e524fd tempest-CinderUnicodeTest-741526917 None] Lock "cinder-31885759-03dc-403a-97e0-a214f92c3601-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d656a6e4-2030-4834-aa08-058d3eb3d0e8 tempest-VolumesTransfersTest-2137451687 None] Lock "cinder-0d27cc5f-fd73-4cbd-b72d-a675e423c9c2-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:00 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9" returned: 0 in 0.589s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:00 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9
Apr 13 18:49:00 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:00 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336 1073741824" returned: 0 in 0.477s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_service.periodic_task [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:00 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336
Apr 13 18:49:00 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:00 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:00 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:01 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-339917a9-49c8-4ec7-86ad-706a3e3b2af9" returned: 0 in 0.442s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Lock "cinder-quobyte-339917a9-49c8-4ec7-86ad-706a3e3b2af9" released by "delete_volume" :: held 1.053s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Created reservations ['5cbabb1e-3a17-4a61-972c-3c15010bf599', '14ffc2fe-1de2-42dc-b3df-434f502a2d5c', 'c1a49c65-6573-46ca-829b-50e6199ca1e5', '240541cd-e72b-4822-94bb-6c7c8a027f32'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:01 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:01 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:01 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.427s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:01 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336" returned: 0 in 0.485s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777925ab-71b6-4cc6-a3ae-b15f36af8908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4618cc-2673-40d7-9594-0d15b43db336', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1642ac-0249-43a5-982e-98782b5e6c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:01 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Volume volume-cd4618cc-2673-40d7-9594-0d15b43db336 (cd4618cc-2673-40d7-9594-0d15b43db336): created successfully
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1642ac-0249-43a5-982e-98782b5e6c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Flow 'volume_create_manager' (accb95b6-0cd9-4480-96f1-3c24c927fa27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:01 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-673af8d7-fac8-4ab4-b156-75cdc8c146c6 tempest-VolumesTransfersTest-827247012 None] Created volume successfully.
Apr 13 18:49:01 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.443s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:01 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Deleted volume successfully.
Apr 13 18:49:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0a07ab90-9038-4cbd-9376-22553f81394d tempest-CinderUnicodeTest-741526917 None] Lock "cinder-339917a9-49c8-4ec7-86ad-706a3e3b2af9-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Acquiring lock "cinder-cd4618cc-2673-40d7-9594-0d15b43db336-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Lock "cinder-cd4618cc-2673-40d7-9594-0d15b43db336-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Acquiring lock "cinder-quobyte-cd4618cc-2673-40d7-9594-0d15b43db336" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Lock "cinder-quobyte-cd4618cc-2673-40d7-9594-0d15b43db336" acquired by "delete_volume" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:02 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47c54f-2433-478e-b118-140d8dec0c9b]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:02 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336
Apr 13 18:49:02 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:03 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336" returned: 0 in 0.552s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:03 devstack sudo[89800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336
Apr 13 18:49:03 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:03 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-cd4618cc-2673-40d7-9594-0d15b43db336" returned: 0 in 0.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Lock "cinder-quobyte-cd4618cc-2673-40d7-9594-0d15b43db336" released by "delete_volume" :: held 1.044s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Created reservations ['9f20a21c-b789-4f21-8cf5-a50cbe589b01', 'b752c85a-9b80-4d5c-b731-2bf49ff1a387', 'a8e76c06-3fb2-43f3-9ea2-66433b790ab7', '99946657-cf99-4e56-8e95-aaa40f037315'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:03 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:03 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:04 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.437s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:04 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:04 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Deleted volume successfully.
Apr 13 18:49:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c37c08c4-bf29-4215-a1f0-c0f3ec9b2300 tempest-VolumesTransfersTest-2137451687 None] Lock "cinder-cd4618cc-2673-40d7-9594-0d15b43db336-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (52b9fa39-17c7-42c3-8eb5-ac71113e304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f68526-9b27-47f3-99e7-038f751ab7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f68526-9b27-47f3-99e7-038f751ab7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278446269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e426e3b8-8af7-425a-859c-d65720dc5dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:08Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66879e7c-3c79-4645-9c29-8c3ce26b2b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66879e7c-3c79-4645-9c29-8c3ce26b2b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aebebec-392c-4c22-ad10-27475e463af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aebebec-392c-4c22-ad10-27475e463af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e426e3b8-8af7-425a-859c-d65720dc5dd1', 'volume_name': 'volume-e426e3b8-8af7-425a-859c-d65720dc5dd1', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d798de-7aa7-432d-aef3-7bcb894f44e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d798de-7aa7-432d-aef3-7bcb894f44e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02f4fc3-01fa-4324-8065-40c6dcc27301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Volume e426e3b8-8af7-425a-859c-d65720dc5dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e426e3b8-8af7-425a-859c-d65720dc5dd1', 'volume_size': 1}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278446269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e426e3b8-8af7-425a-859c-d65720dc5dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:08Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Creating volume e426e3b8-8af7-425a-859c-d65720dc5dd1 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:08 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:08 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1 1073741824
Apr 13 18:49:08 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (8ec37153-0793-4c25-ba25-a67b4d57e22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19ef6e7-d3bf-49c4-9aaa-fd5ee28f10bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19ef6e7-d3bf-49c4-9aaa-fd5ee28f10bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489510239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90448788-a63a-430c-8000-0a68e4e0c44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:09Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ea62f5-9dd5-44cd-b875-71b9a32fb297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ea62f5-9dd5-44cd-b875-71b9a32fb297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3fedd9-6961-42af-9ee8-a38b015477f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3fedd9-6961-42af-9ee8-a38b015477f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90448788-a63a-430c-8000-0a68e4e0c44a', 'volume_name': 'volume-90448788-a63a-430c-8000-0a68e4e0c44a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4719c9d-71a3-4224-8a61-bf43032368e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4719c9d-71a3-4224-8a61-bf43032368e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38320341-d675-47cd-82c0-9cb067f85463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Volume 90448788-a63a-430c-8000-0a68e4e0c44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90448788-a63a-430c-8000-0a68e4e0c44a', 'volume_size': 1}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (f7b385cd-dc1f-474d-913b-d5b7a27f6140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2981bc5-beca-4b8b-8862-f1f8f2e26ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2981bc5-beca-4b8b-8862-f1f8f2e26ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-165531713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f299c0-bf2a-48b5-a305-cf6418fe05b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:09Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b398b1e-b8cc-40f8-b6f7-e7d01b5085d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b398b1e-b8cc-40f8-b6f7-e7d01b5085d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e545fd5-81f9-4e23-a587-3e483f79c130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e545fd5-81f9-4e23-a587-3e483f79c130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f299c0-bf2a-48b5-a305-cf6418fe05b8', 'volume_name': 'volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0deb4b13-9355-4ed0-a846-3f4245c0c439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0deb4b13-9355-4ed0-a846-3f4245c0c439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2136cfbf-1be2-4705-bba5-2f3326c4cc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:08 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Volume 92f299c0-bf2a-48b5-a305-cf6418fe05b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8', 'volume_size': 1}
Apr 13 18:49:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (c28977be-8fe1-455a-830f-95ad6175dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8119ce-a6d5-42ae-b594-6001c9ddd473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8119ce-a6d5-42ae-b594-6001c9ddd473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920238255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fb2759-f82a-47ae-b649-1babd969e0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:09Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f61d8bf-4df9-42a1-823a-6e2c1ae01189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f61d8bf-4df9-42a1-823a-6e2c1ae01189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35de1604-0639-4a85-853a-55dfa3d9d9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35de1604-0639-4a85-853a-55dfa3d9d9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49fb2759-f82a-47ae-b649-1babd969e0fd', 'volume_name': 'volume-49fb2759-f82a-47ae-b649-1babd969e0fd', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b020e0c-80f3-47e8-bd73-58f0d8e08c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b020e0c-80f3-47e8-bd73-58f0d8e08c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e890bf0-615d-4778-b918-a549e67cec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Volume 49fb2759-f82a-47ae-b649-1babd969e0fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49fb2759-f82a-47ae-b649-1babd969e0fd', 'volume_size': 1}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1 1073741824" returned: 0 in 0.717s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:09 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1
Apr 13 18:49:09 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (d38dfe96-6b45-4314-ae38-f11ad9d42e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf253437-e875-407a-8ceb-dd17445f7f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf253437-e875-407a-8ceb-dd17445f7f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-467591311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605b9e14-3c6a-492f-975a-e8a7db674325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:09Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca08c56-780f-4d7e-b967-091be2043cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca08c56-780f-4d7e-b967-091be2043cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a761fda-4d4b-4d52-992e-2bd3f0ce36d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a761fda-4d4b-4d52-992e-2bd3f0ce36d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605b9e14-3c6a-492f-975a-e8a7db674325', 'volume_name': 'volume-605b9e14-3c6a-492f-975a-e8a7db674325', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660d8803-131f-4070-965c-af78ff5400bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660d8803-131f-4070-965c-af78ff5400bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379e377a-5bec-4ec5-96e7-52fcebd001e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Volume 605b9e14-3c6a-492f-975a-e8a7db674325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605b9e14-3c6a-492f-975a-e8a7db674325', 'volume_size': 1}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:09 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1" returned: 0 in 0.497s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.089s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489510239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90448788-a63a-430c-8000-0a68e4e0c44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:09Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Creating volume 90448788-a63a-430c-8000-0a68e4e0c44a {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:09 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:09 devstack sudo[89816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a 1073741824
Apr 13 18:49:09 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02f4fc3-01fa-4324-8065-40c6dcc27301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e426e3b8-8af7-425a-859c-d65720dc5dd1', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63f750b-a100-4ff6-a094-4364776375b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:09 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Volume volume-e426e3b8-8af7-425a-859c-d65720dc5dd1 (e426e3b8-8af7-425a-859c-d65720dc5dd1): created successfully
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63f750b-a100-4ff6-a094-4364776375b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:09 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (52b9fa39-17c7-42c3-8eb5-ac71113e304b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:09 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9a96d3be-51ac-471d-a147-7679f7468a34 tempest-CreateVolumesFromImageTest-30171082 None] Created volume successfully.
Apr 13 18:49:10 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a 1073741824" returned: 0 in 0.544s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:10 devstack sudo[89821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a
Apr 13 18:49:10 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:10 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a" returned: 0 in 0.453s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.764s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-165531713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f299c0-bf2a-48b5-a305-cf6418fe05b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:09Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Creating volume 92f299c0-bf2a-48b5-a305-cf6418fe05b8 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:10 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38320341-d675-47cd-82c0-9cb067f85463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90448788-a63a-430c-8000-0a68e4e0c44a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:10 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8 1073741824
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a78c091-3aad-4cf9-9556-787968d8ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:10 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:10 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Volume volume-90448788-a63a-430c-8000-0a68e4e0c44a (90448788-a63a-430c-8000-0a68e4e0c44a): created successfully
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a78c091-3aad-4cf9-9556-787968d8ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (8ec37153-0793-4c25-ba25-a67b4d57e22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:10 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a275e7ee-8429-4db7-a0fb-bf27cd2728a2 tempest-CreateVolumesFromImageTest-30171082 None] Created volume successfully.
Apr 13 18:49:11 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8 1073741824" returned: 0 in 0.546s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:11 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8
Apr 13 18:49:11 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:11 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8" returned: 0 in 0.473s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.607s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920238255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fb2759-f82a-47ae-b649-1babd969e0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:09Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Creating volume 49fb2759-f82a-47ae-b649-1babd969e0fd {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:11 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2136cfbf-1be2-4705-bba5-2f3326c4cc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:11 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd 1073741824
Apr 13 18:49:11 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd94b56e-5e3b-4d08-863c-3ffe27a3cc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:11 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Volume volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8 (92f299c0-bf2a-48b5-a305-cf6418fe05b8): created successfully
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd94b56e-5e3b-4d08-863c-3ffe27a3cc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (f7b385cd-dc1f-474d-913b-d5b7a27f6140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:11 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-402e667a-ebe4-4685-8007-20fc66af4e0c tempest-CreateVolumesFromImageTest-30171082 None] Created volume successfully.
Apr 13 18:49:12 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd 1073741824" returned: 0 in 0.526s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:12 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd
Apr 13 18:49:12 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:12 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd" returned: 0 in 0.451s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.415s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-467591311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605b9e14-3c6a-492f-975a-e8a7db674325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa3425c86414967900f682603e3a410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:09Z,use_quota=True,user_id='de9fd1fd99744118839f4359d67921bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Creating volume 605b9e14-3c6a-492f-975a-e8a7db674325 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:12 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e890bf0-615d-4778-b918-a549e67cec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fb2759-f82a-47ae-b649-1babd969e0fd', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf57ee2-5f76-488b-99c9-40c88a303c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:12 devstack sudo[89840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325 1073741824
Apr 13 18:49:12 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:12 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Volume volume-49fb2759-f82a-47ae-b649-1babd969e0fd (49fb2759-f82a-47ae-b649-1babd969e0fd): created successfully
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf57ee2-5f76-488b-99c9-40c88a303c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:12 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (c28977be-8fe1-455a-830f-95ad6175dea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:12 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e35e86e1-ade3-4b4e-a35f-6b81a4c4ad53 tempest-CreateVolumesFromImageTest-30171082 None] Created volume successfully.
Apr 13 18:49:13 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325 1073741824" returned: 0 in 0.576s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:13 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325
Apr 13 18:49:13 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:13 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325" returned: 0 in 0.440s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:13 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:49:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379e377a-5bec-4ec5-96e7-52fcebd001e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605b9e14-3c6a-492f-975a-e8a7db674325', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f438525-b152-4715-8c9b-c3a8ddb5a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:13 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Volume volume-605b9e14-3c6a-492f-975a-e8a7db674325 (605b9e14-3c6a-492f-975a-e8a7db674325): created successfully
Apr 13 18:49:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f438525-b152-4715-8c9b-c3a8ddb5a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:13 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Flow 'volume_create_manager' (d38dfe96-6b45-4314-ae38-f11ad9d42e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-709f2fd9-492f-4adb-812e-5e4756206003 tempest-CreateVolumesFromImageTest-30171082 None] Created volume successfully.
Apr 13 18:49:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-605b9e14-3c6a-492f-975a-e8a7db674325-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-605b9e14-3c6a-492f-975a-e8a7db674325-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-quobyte-605b9e14-3c6a-492f-975a-e8a7db674325" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-605b9e14-3c6a-492f-975a-e8a7db674325" acquired by "delete_volume" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:14 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7df63bc-89f3-4439-8f76-313a4a55a553]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:14 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325
Apr 13 18:49:14 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:15 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325" returned: 0 in 0.530s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:15 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325
Apr 13 18:49:15 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:15 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-605b9e14-3c6a-492f-975a-e8a7db674325" returned: 0 in 0.440s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-605b9e14-3c6a-492f-975a-e8a7db674325" released by "delete_volume" :: held 0.995s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Created reservations ['cf437fee-556e-4103-90c8-7018a073cd45', '384f7bb2-0034-42c3-bb72-3e181f105030', '693ea5a2-2601-4c52-9bbe-5c4fb5eb021d', '177336b2-9a18-4b27-afeb-31d2e5e8e038'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:16 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:16 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:16 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.499s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:16 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:16 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Deleted volume successfully.
Apr 13 18:49:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-069c5db5-32c8-46d6-83f7-f186601f648d tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-605b9e14-3c6a-492f-975a-e8a7db674325-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-49fb2759-f82a-47ae-b649-1babd969e0fd-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-49fb2759-f82a-47ae-b649-1babd969e0fd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-quobyte-49fb2759-f82a-47ae-b649-1babd969e0fd" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-49fb2759-f82a-47ae-b649-1babd969e0fd" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec1571c-5293-47b5-a5e4-855e12b0bb33]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:17 devstack sudo[89866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd
Apr 13 18:49:17 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:17 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd" returned: 0 in 0.598s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:17 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd
Apr 13 18:49:17 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Flow 'volume_create_manager' (88617efd-2077-4eda-89ad-c08863f8e549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ecea29-bebd-40d9-b9ce-98b4a9978844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ecea29-bebd-40d9-b9ce-98b4a9978844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-281352738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4450c78-9569-4d2c-808b-4662094a5d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339f3cab86674f8ba692f876c49f940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:18Z,use_quota=True,user_id='ec27cd486731435b873fe002e996a2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddad74e-a4ae-4f7a-bc33-61644eb09331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddad74e-a4ae-4f7a-bc33-61644eb09331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2d0870-ea2a-4668-9833-fcd7c0b40e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2d0870-ea2a-4668-9833-fcd7c0b40e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4450c78-9569-4d2c-808b-4662094a5d83', 'volume_name': 'volume-a4450c78-9569-4d2c-808b-4662094a5d83', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91259653-79dc-4302-94a1-42ca838024d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91259653-79dc-4302-94a1-42ca838024d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eef8060-8f7f-4eaf-9d47-245e366df44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:17 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Volume a4450c78-9569-4d2c-808b-4662094a5d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4450c78-9569-4d2c-808b-4662094a5d83', 'volume_size': 1}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-281352738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4450c78-9569-4d2c-808b-4662094a5d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339f3cab86674f8ba692f876c49f940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:18Z,use_quota=True,user_id='ec27cd486731435b873fe002e996a2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Creating volume a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:17 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:49:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:17 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 1073741824
Apr 13 18:49:17 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:18 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-49fb2759-f82a-47ae-b649-1babd969e0fd" returned: 0 in 0.468s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-49fb2759-f82a-47ae-b649-1babd969e0fd" released by "delete_volume" :: held 1.097s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Created reservations ['5da28306-95c1-4563-a1f2-82b782b812e9', '3eeab62b-84f9-4591-9348-8429fc281e12', '55480280-fd43-43ae-b5bb-01dbc6637aea', 'fcdae33f-b2e6-4410-b7d2-5b0c6bc0cb35'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:18 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:18 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:18 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 1073741824" returned: 0 in 0.521s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:18 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83
Apr 13 18:49:18 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:18 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.423s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Deleted volume successfully.
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-617e2c14-09bc-40e3-b70c-7999b873891d tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-49fb2759-f82a-47ae-b649-1babd969e0fd-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:18 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83" returned: 0 in 0.402s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eef8060-8f7f-4eaf-9d47-245e366df44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4450c78-9569-4d2c-808b-4662094a5d83', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0094160-b5f3-4392-96dd-154bf5741a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:18 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Volume volume-a4450c78-9569-4d2c-808b-4662094a5d83 (a4450c78-9569-4d2c-808b-4662094a5d83): created successfully
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0094160-b5f3-4392-96dd-154bf5741a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Flow 'volume_create_manager' (88617efd-2077-4eda-89ad-c08863f8e549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:18 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-beb8ba31-3d8a-4baf-80aa-01f245953e2b tempest-SnapshotDependencyTests-382137811 None] Created volume successfully.
Apr 13 18:49:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-92f299c0-bf2a-48b5-a305-cf6418fe05b8-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-92f299c0-bf2a-48b5-a305-cf6418fe05b8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-quobyte-92f299c0-bf2a-48b5-a305-cf6418fe05b8" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:19 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-92f299c0-bf2a-48b5-a305-cf6418fe05b8" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:19 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e75101d-b3b4-42e4-bb47-19246e4bd396]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:19 devstack sudo[89885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8
Apr 13 18:49:19 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:19 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8" returned: 0 in 0.451s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:19 devstack sudo[89890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8
Apr 13 18:49:19 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:20 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-92f299c0-bf2a-48b5-a305-cf6418fe05b8" returned: 0 in 0.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-92f299c0-bf2a-48b5-a305-cf6418fe05b8" released by "delete_volume" :: held 0.948s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Creating offline snapshot 106ae669-796b-467e-852f-9a97189e9c4f of volume a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea813b-f40d-4715-84b2-b04b9738b64b]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Created reservations ['9207f753-4e73-4fa7-bcdc-fa658c87bcd2', '0639fea4-dbcc-46ee-ab47-efb8fc666ffd', 'ae2b7867-01ce-4184-af4f-330083910286', '27dafbf3-a39d-436d-9464-7683477147cb'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:20 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83
Apr 13 18:49:20 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:20 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:20 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-90448788-a63a-430c-8000-0a68e4e0c44a-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-90448788-a63a-430c-8000-0a68e4e0c44a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-quobyte-90448788-a63a-430c-8000-0a68e4e0c44a" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-90448788-a63a-430c-8000-0a68e4e0c44a" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8c644-b926-4866-8c75-b261b2d71e16]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:20 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a
Apr 13 18:49:20 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:20 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.420s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:20 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83" returned: 0 in 0.487s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:20 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Deleted volume successfully.
Apr 13 18:49:20 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f 1G
Apr 13 18:49:20 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1dbf6671-87fc-4507-a53f-348043e5078c tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-92f299c0-bf2a-48b5-a305-cf6418fe05b8-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:20 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a" returned: 0 in 0.521s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:20 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a
Apr 13 18:49:20 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:21 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f 1G" returned: 0 in 0.482s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4450c78-9569-4d2c-808b-4662094a5d83 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:21 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4450c78-9569-4d2c-808b-4662094a5d83 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f
Apr 13 18:49:21 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:21 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-90448788-a63a-430c-8000-0a68e4e0c44a" returned: 0 in 0.437s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-90448788-a63a-430c-8000-0a68e4e0c44a" released by "delete_volume" :: held 0.980s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Created reservations ['645c9333-bf85-4426-886c-e60c1ba4dd2e', 'a6b9cd66-7c48-4686-bbfd-17fecadd6375', 'dee8cf46-2b85-4dc7-8406-ca96e7613370', '7bbfa438-bd4a-4281-8660-2048ea5fe971'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:21 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:21 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-e426e3b8-8af7-425a-859c-d65720dc5dd1-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-e426e3b8-8af7-425a-859c-d65720dc5dd1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "cinder-quobyte-e426e3b8-8af7-425a-859c-d65720dc5dd1" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-e426e3b8-8af7-425a-859c-d65720dc5dd1" acquired by "delete_volume" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a41a436-16e5-45d9-8034-3deeb0d1bbf6]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:21 devstack sudo[89953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1
Apr 13 18:49:21 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:21 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4450c78-9569-4d2c-808b-4662094a5d83 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f" returned: 0 in 0.451s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:21 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f is being set with open permissions: ugo+rw
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:21 devstack sudo[89958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f
Apr 13 18:49:21 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:21 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.451s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Deleted volume successfully.
Apr 13 18:49:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-db870e8f-aac5-4c01-9e0b-69956b1956b8 tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-90448788-a63a-430c-8000-0a68e4e0c44a-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:22 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1" returned: 0 in 0.514s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:22 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1
Apr 13 18:49:22 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:22 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f" returned: 0 in 0.429s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:22 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.info
Apr 13 18:49:22 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:22 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e426e3b8-8af7-425a-859c-d65720dc5dd1" returned: 0 in 0.399s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-quobyte-e426e3b8-8af7-425a-859c-d65720dc5dd1" released by "delete_volume" :: held 0.933s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Created reservations ['9421da88-7e85-435c-ace6-51e95288b89e', '985ad6db-f8dd-4c56-89ce-d126f6ebc3b3', 'c1b1cdfa-a8c6-4d8d-92d5-cc82aaa38b44', '7907a54f-e6f5-495b-ad64-a83fd859ff94'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:22 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.info" returned: 0 in 0.446s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:22 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.info is being set with open permissions: ugo+rw
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:22 devstack sudo[89971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:22 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:22 devstack sudo[89972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.info
Apr 13 18:49:22 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:22 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.450s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Deleted volume successfully.
Apr 13 18:49:22 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.info" returned: 0 in 0.454s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.804s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1119066c-e1d4-4094-be2f-c3c58904c970 tempest-CreateVolumesFromImageTest-30171082 None] Lock "cinder-e426e3b8-8af7-425a-859c-d65720dc5dd1-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4abb7fa5-be76-428c-8d38-80318d641393 tempest-SnapshotDependencyTests-382137811 None] Create snapshot completed successfully
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Flow 'volume_create_manager' (01a457de-28eb-4ce4-9b51-e33d9c2167d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c159dca-16e6-493a-bd31-39c3edcecef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c159dca-16e6-493a-bd31-39c3edcecef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79a6138-72c5-42a0-a978-473702eb5547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='339f3cab86674f8ba692f876c49f940f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=106ae669-796b-467e-852f-9a97189e9c4f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:24Z,use_quota=True,user_id='ec27cd486731435b873fe002e996a2e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec93c493-9a89-47e3-89f5-46f187a081ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec93c493-9a89-47e3-89f5-46f187a081ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9ee64b-dd4b-4e86-88c2-edc575148f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9ee64b-dd4b-4e86-88c2-edc575148f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e79a6138-72c5-42a0-a978-473702eb5547', 'volume_name': 'volume-e79a6138-72c5-42a0-a978-473702eb5547', 'volume_size': 1, 'snapshot_id': '106ae669-796b-467e-852f-9a97189e9c4f'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea89cc9c-4e8c-4147-8286-4ec9e3d41a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea89cc9c-4e8c-4147-8286-4ec9e3d41a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcc5436-ce0b-4cf6-9f93-36e77d8a3f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:23 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Volume e79a6138-72c5-42a0-a978-473702eb5547: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e79a6138-72c5-42a0-a978-473702eb5547', 'volume_size': 1, 'snapshot_id': '106ae669-796b-467e-852f-9a97189e9c4f'}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "cinder-quobyte-106ae669-796b-467e-852f-9a97189e9c4f-e79a6138-72c5-42a0-a978-473702eb5547" by "_create_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-106ae669-796b-467e-852f-9a97189e9c4f-e79a6138-72c5-42a0-a978-473702eb5547" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Creating volume e79a6138-72c5-42a0-a978-473702eb5547 from snapshot 106ae669-796b-467e-852f-9a97189e9c4f {{(pid=82517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "cinder-quobyte-e79a6138-72c5-42a0-a978-473702eb5547" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-e79a6138-72c5-42a0-a978-473702eb5547" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] snapshot: 106ae669-796b-467e-852f-9a97189e9c4f, volume: e79a6138-72c5-42a0-a978-473702eb5547,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59b1476-6de5-4993-b389-1351989c1803]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:23 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f
Apr 13 18:49:23 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Flow 'volume_create_manager' (793b1629-d8e3-49fe-9dea-53e4d3b0a1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e1f3cd-7b1b-4df7-a41a-0a916ad84aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e1f3cd-7b1b-4df7-a41a-0a916ad84aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1317616615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623b145f-4f86-4ec9-b606-f5bcdc640f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a80b46fc784b53b3c1eff464bf1533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:24Z,use_quota=True,user_id='558a5abde0584dcf8b2d6a8b05461b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c9e349-4fb1-4f70-84d3-e387a3e6ff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c9e349-4fb1-4f70-84d3-e387a3e6ff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fe7856-af73-4e84-8814-a363ed9bd8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fe7856-af73-4e84-8814-a363ed9bd8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623b145f-4f86-4ec9-b606-f5bcdc640f2a', 'volume_name': 'volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ad501b-4b34-40a6-b27a-8dc444458349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ad501b-4b34-40a6-b27a-8dc444458349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac426ee7-65d2-4580-aed0-d927fb423aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:24 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Volume 623b145f-4f86-4ec9-b606-f5bcdc640f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a', 'volume_size': 1}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:24 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f" returned: 0 in 0.492s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4450c78-9569-4d2c-808b-4662094a5d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ed9d02-c440-4144-97f2-c1f8f5eeb1b7]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:24 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83
Apr 13 18:49:24 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:24 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83" returned: 0 in 0.457s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547 not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:49:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:24 devstack sudo[89989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547
Apr 13 18:49:24 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:26 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547" returned: 0 in 1.990s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:26 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[15896336-1b0a-4e45-8648-4002d75ff8fe]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:26 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83
Apr 13 18:49:26 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:27 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83" returned: 0 in 0.600s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547 {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:49:27 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Converted 1024.00 MB image at 514.21 MB/s
Apr 13 18:49:27 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547 is being set with open permissions: ugo+rw
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:27 devstack sudo[90007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547
Apr 13 18:49:27 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:27 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547" returned: 0 in 0.413s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-e79a6138-72c5-42a0-a978-473702eb5547" released by "_copy_volume_from_snapshot" :: held 4.008s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-106ae669-796b-467e-852f-9a97189e9c4f-e79a6138-72c5-42a0-a978-473702eb5547" released by "_create_volume_from_snapshot" :: held 4.025s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.039s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1317616615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623b145f-4f86-4ec9-b606-f5bcdc640f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a80b46fc784b53b3c1eff464bf1533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:24Z,use_quota=True,user_id='558a5abde0584dcf8b2d6a8b05461b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Creating volume 623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:27 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:27 devstack sudo[90010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a 1073741824
Apr 13 18:49:27 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcc5436-ce0b-4cf6-9f93-36e77d8a3f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79a6138-72c5-42a0-a978-473702eb5547', 'volume_size': 1, 'snapshot_id': '106ae669-796b-467e-852f-9a97189e9c4f'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe59d96-e23f-4a38-a76d-f9556aade932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:27 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Volume volume-e79a6138-72c5-42a0-a978-473702eb5547 (e79a6138-72c5-42a0-a978-473702eb5547): created successfully
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe59d96-e23f-4a38-a76d-f9556aade932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Flow 'volume_create_manager' (01a457de-28eb-4ce4-9b51-e33d9c2167d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:27 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ac11cffe-d8d7-4c92-b9ab-70046babfdb5 tempest-SnapshotDependencyTests-382137811 None] Created volume successfully.
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "cinder-106ae669-796b-467e-852f-9a97189e9c4f-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-106ae669-796b-467e-852f-9a97189e9c4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "cinder-quobyte-a4450c78-9569-4d2c-808b-4662094a5d83" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-a4450c78-9569-4d2c-808b-4662094a5d83" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "cinder-quobyte-106ae669-796b-467e-852f-9a97189e9c4f" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-106ae669-796b-467e-852f-9a97189e9c4f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Deleting offline snapshot 106ae669-796b-467e-852f-9a97189e9c4f of volume a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] snapshot_file for this snap is: volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8967a12-e607-44fa-ab11-2c801085d55e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:28 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f
Apr 13 18:49:28 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:28 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a 1073741824" returned: 0 in 0.469s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:28 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a
Apr 13 18:49:28 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:28 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f" returned: 0 in 0.499s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4450c78-9569-4d2c-808b-4662094a5d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fddd08d-b4d8-4c2b-b156-e5de865e00e1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:28 devstack sudo[90022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83
Apr 13 18:49:28 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:28 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a" returned: 0 in 0.432s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac426ee7-65d2-4580-aed0-d927fb423aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9899cc80-688e-49dd-a766-3b6112cee0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:28 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Volume volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a (623b145f-4f86-4ec9-b606-f5bcdc640f2a): created successfully
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9899cc80-688e-49dd-a766-3b6112cee0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Flow 'volume_create_manager' (793b1629-d8e3-49fe-9dea-53e4d3b0a1bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-7bf02e7d-1f97-4af8-92d0-0758da842b5d tempest-VolumeDependencyTests-315519831 None] Created volume successfully.
Apr 13 18:49:28 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83" returned: 0 in 0.462s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:28 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f
Apr 13 18:49:28 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:29 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f" returned: 0 in 0.453s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:29 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f
Apr 13 18:49:29 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Creating offline snapshot f729d01a-8de1-4625-86e3-b7250dfcf5a4 of volume 623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e9c20a-fddc-4c92-bd67-137046111ceb]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:29 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a
Apr 13 18:49:29 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:29 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83.106ae669-796b-467e-852f-9a97189e9c4f" returned: 0 in 0.421s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-106ae669-796b-467e-852f-9a97189e9c4f" released by "_delete_snapshot" :: held 1.884s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-a4450c78-9569-4d2c-808b-4662094a5d83" released by "delete_snapshot" :: held 1.895s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Created reservations ['cbabdf08-0860-4123-8390-2894cbdd85bf', 'ab18e5cf-2751-4e1e-86bc-fa8174334648', '38a29f27-b1a0-403b-ba76-f0c851d061d7', 'bea0ea06-8f0b-49de-a002-113cdf241dd8'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:29 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Delete snapshot completed successfully.
Apr 13 18:49:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3d9d533a-76c1-409b-aaaf-ac5441c08084 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-106ae669-796b-467e-852f-9a97189e9c4f-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "cinder-a4450c78-9569-4d2c-808b-4662094a5d83-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-a4450c78-9569-4d2c-808b-4662094a5d83-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "cinder-quobyte-a4450c78-9569-4d2c-808b-4662094a5d83" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-a4450c78-9569-4d2c-808b-4662094a5d83" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:30 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a" returned: 0 in 0.486s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d4a384-4928-4b54-a688-957917fab199]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:30 devstack sudo[90041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 1G
Apr 13 18:49:30 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:30 devstack sudo[90042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83
Apr 13 18:49:30 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:30 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 1G" returned: 0 in 0.468s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:30 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:30 devstack sudo[90051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4
Apr 13 18:49:30 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83" returned: 0 in 0.482s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:30 devstack sudo[90053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83
Apr 13 18:49:30 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:30 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a4450c78-9569-4d2c-808b-4662094a5d83" returned: 0 in 0.400s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-a4450c78-9569-4d2c-808b-4662094a5d83" released by "delete_volume" :: held 0.929s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:30 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4" returned: 0 in 0.444s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:30 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 is being set with open permissions: ugo+rw
Apr 13 18:49:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:31 devstack sudo[90059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4
Apr 13 18:49:31 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Created reservations ['5bec68ac-bf70-4323-9027-b1037601524e', 'a0ea1108-a2b0-489b-b925-98ca3c84a328', '401b8cea-2c93-41b1-825f-0b7004d54263', 'adbbae17-9979-4fcb-ab37-b70464e102a0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:31 devstack sudo[90061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:31 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "cinder-e79a6138-72c5-42a0-a978-473702eb5547-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-e79a6138-72c5-42a0-a978-473702eb5547-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "cinder-quobyte-e79a6138-72c5-42a0-a978-473702eb5547" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-e79a6138-72c5-42a0-a978-473702eb5547" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f471d67-eda2-4122-9cc0-4ab33c6139f6]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:31 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547
Apr 13 18:49:31 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:31 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4" returned: 0 in 0.404s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:31 devstack sudo[90066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.info
Apr 13 18:49:31 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:31 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.428s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:31 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Deleted volume successfully.
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c8c40484-d2cb-4258-9c76-5a69e2f90c69 tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-a4450c78-9569-4d2c-808b-4662094a5d83-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:31 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547" returned: 0 in 0.486s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:31 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547
Apr 13 18:49:31 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:31 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.info" returned: 0 in 0.414s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:31 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.info is being set with open permissions: ugo+rw
Apr 13 18:49:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:31 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.info
Apr 13 18:49:31 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:32 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79a6138-72c5-42a0-a978-473702eb5547" returned: 0 in 0.392s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-quobyte-e79a6138-72c5-42a0-a978-473702eb5547" released by "delete_volume" :: held 0.900s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Created reservations ['0aec2e41-23b0-4ad5-8171-874992035156', '303605a9-f315-4f1f-8184-7a63fb05970e', '40193db7-7c83-4562-9b47-fd55cac9eb1b', '0243b1e0-c081-4d1c-a3c0-a5323e5cbbd9'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:32 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:32 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:32 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.info" returned: 0 in 0.416s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:32 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c2ff8e37-7b60-4734-bec8-758eb1a0103b tempest-VolumeDependencyTests-315519831 None] Create snapshot completed successfully
Apr 13 18:49:32 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.461s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:32 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Deleted volume successfully.
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-60b35e51-4d7d-4f8d-bbfd-00c3c0ba523f tempest-SnapshotDependencyTests-382137811 None] Lock "cinder-e79a6138-72c5-42a0-a978-473702eb5547-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Flow 'volume_create_manager' (b8088fb3-bec2-4d2d-b1f3-532c8dd0b7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:32 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ddddd5-f3bf-4436-9af8-5d167fdc72e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ddddd5-f3bf-4436-9af8-5d167fdc72e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-840189548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483e8ed6-fa6b-4910-9f83-739a59cffcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a80b46fc784b53b3c1eff464bf1533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f729d01a-8de1-4625-86e3-b7250dfcf5a4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:33Z,use_quota=True,user_id='558a5abde0584dcf8b2d6a8b05461b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0db24c6-15d3-4530-aea9-1a9bca07cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0db24c6-15d3-4530-aea9-1a9bca07cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd27c2a-0502-46e0-ae67-91cd2fce099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd27c2a-0502-46e0-ae67-91cd2fce099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '483e8ed6-fa6b-4910-9f83-739a59cffcb0', 'volume_name': 'volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0', 'volume_size': 1, 'snapshot_id': 'f729d01a-8de1-4625-86e3-b7250dfcf5a4'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ad8fd1-3e82-41a8-86ac-f1c9bf451771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ad8fd1-3e82-41a8-86ac-f1c9bf451771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1e4435-e8aa-42bc-a8b7-7d1168384b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:33 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Volume 483e8ed6-fa6b-4910-9f83-739a59cffcb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0', 'volume_size': 1, 'snapshot_id': 'f729d01a-8de1-4625-86e3-b7250dfcf5a4'}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-f729d01a-8de1-4625-86e3-b7250dfcf5a4-483e8ed6-fa6b-4910-9f83-739a59cffcb0" by "_create_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-f729d01a-8de1-4625-86e3-b7250dfcf5a4-483e8ed6-fa6b-4910-9f83-739a59cffcb0" acquired by "_create_volume_from_snapshot" :: waited 0.005s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Creating volume 483e8ed6-fa6b-4910-9f83-739a59cffcb0 from snapshot f729d01a-8de1-4625-86e3-b7250dfcf5a4 {{(pid=82517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-483e8ed6-fa6b-4910-9f83-739a59cffcb0" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-483e8ed6-fa6b-4910-9f83-739a59cffcb0" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] snapshot: f729d01a-8de1-4625-86e3-b7250dfcf5a4, volume: 483e8ed6-fa6b-4910-9f83-739a59cffcb0,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d6088f-145a-4289-9149-2ab320302371]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:33 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4
Apr 13 18:49:33 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:33 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4" returned: 0 in 0.538s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8fac8a-1415-4a53-8184-bf6a36a51284]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:33 devstack sudo[90089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a
Apr 13 18:49:33 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:34 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a" returned: 0 in 0.543s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:34 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0 not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:49:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:34 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0
Apr 13 18:49:34 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:36 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0" returned: 0 in 2.161s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:36 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d192a0c-92b4-45f5-ba3c-f023c968f345]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:36 devstack sudo[90108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a
Apr 13 18:49:36 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:36 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a" returned: 0 in 0.601s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:36 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0 {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:49:36 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Converted 1024.00 MB image at 473.60 MB/s
Apr 13 18:49:36 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0 is being set with open permissions: ugo+rw
Apr 13 18:49:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:36 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0
Apr 13 18:49:36 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:37 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0" returned: 0 in 0.436s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-483e8ed6-fa6b-4910-9f83-739a59cffcb0" released by "_copy_volume_from_snapshot" :: held 4.331s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-f729d01a-8de1-4625-86e3-b7250dfcf5a4-483e8ed6-fa6b-4910-9f83-739a59cffcb0" released by "_create_volume_from_snapshot" :: held 4.350s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.357s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1e4435-e8aa-42bc-a8b7-7d1168384b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0', 'volume_size': 1, 'snapshot_id': 'f729d01a-8de1-4625-86e3-b7250dfcf5a4'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1079dc0e-39e7-45af-bd6a-8731f18aea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:37 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Volume volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0 (483e8ed6-fa6b-4910-9f83-739a59cffcb0): created successfully
Apr 13 18:49:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1079dc0e-39e7-45af-bd6a-8731f18aea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Flow 'volume_create_manager' (b8088fb3-bec2-4d2d-b1f3-532c8dd0b7e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:37 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-deed8cc7-3275-4c90-b1a9-2cda939cc9bb tempest-VolumeDependencyTests-315519831 None] Created volume successfully.
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-f729d01a-8de1-4625-86e3-b7250dfcf5a4-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Lock "cinder-f729d01a-8de1-4625-86e3-b7250dfcf5a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-623b145f-4f86-4ec9-b606-f5bcdc640f2a" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-623b145f-4f86-4ec9-b606-f5bcdc640f2a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-f729d01a-8de1-4625-86e3-b7250dfcf5a4" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-f729d01a-8de1-4625-86e3-b7250dfcf5a4" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Deleting offline snapshot f729d01a-8de1-4625-86e3-b7250dfcf5a4 of volume 623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] snapshot_file for this snap is: volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce6a488-158f-4262-be59-4b60e3efc408]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:38 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4
Apr 13 18:49:38 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:38 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4" returned: 0 in 0.500s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdc9fee-f2c7-458d-a4aa-ffaa16b9a659]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:39 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a
Apr 13 18:49:39 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:39 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a" returned: 0 in 0.582s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:39 devstack sudo[90128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4
Apr 13 18:49:39 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:39 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4" returned: 0 in 0.433s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:40 devstack sudo[90133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4
Apr 13 18:49:40 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:40 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a.f729d01a-8de1-4625-86e3-b7250dfcf5a4" returned: 0 in 0.402s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-f729d01a-8de1-4625-86e3-b7250dfcf5a4" released by "_delete_snapshot" :: held 1.977s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-623b145f-4f86-4ec9-b606-f5bcdc640f2a" released by "delete_snapshot" :: held 1.988s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Created reservations ['72bec94a-78f1-431b-99fa-db6cccaf4960', '8622b7d1-3939-49ff-b04e-48ade79756bd', 'b7acb578-d9f2-4b97-8d8d-d618a49630d2', '39a8ad32-19b8-4268-95f0-5e2a83e25434'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:40 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Delete snapshot completed successfully.
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0080e591-8e60-41aa-92bd-7478321401ad tempest-VolumeDependencyTests-315519831 None] Lock "cinder-f729d01a-8de1-4625-86e3-b7250dfcf5a4-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-623b145f-4f86-4ec9-b606-f5bcdc640f2a-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Lock "cinder-623b145f-4f86-4ec9-b606-f5bcdc640f2a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-623b145f-4f86-4ec9-b606-f5bcdc640f2a" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-623b145f-4f86-4ec9-b606-f5bcdc640f2a" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6c2933-2f87-473f-8606-4c5cc642c30c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:40 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a
Apr 13 18:49:40 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:41 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a" returned: 0 in 0.456s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:41 devstack sudo[90141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a
Apr 13 18:49:41 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:41 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-623b145f-4f86-4ec9-b606-f5bcdc640f2a" returned: 0 in 0.393s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-623b145f-4f86-4ec9-b606-f5bcdc640f2a" released by "delete_volume" :: held 0.887s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Created reservations ['3a78df12-f36c-4465-84ad-6d373067dcd5', 'c59d8f7d-296d-4549-b623-b0ce4378a3d4', 'dc026c9e-fbd4-4d70-99a5-a1a7e225d3a1', '8518f30e-f5d3-4f6e-9af0-f647c94994a8'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:41 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:41 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Flow 'volume_create_manager' (1e1dfcec-f1d0-4a94-b244-885fcdc8aac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cf1bcf-edc4-47ed-bde8-85edd4dac616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cf1bcf-edc4-47ed-bde8-85edd4dac616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-110946604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260ed2c9-72e7-4313-b52c-967e868591a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a80b46fc784b53b3c1eff464bf1533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:42Z,use_quota=True,user_id='558a5abde0584dcf8b2d6a8b05461b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829d0262-d8e3-43f5-aeb4-47afb49d92f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829d0262-d8e3-43f5-aeb4-47afb49d92f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a516570e-637f-40a4-8f78-5526a3e79c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a516570e-637f-40a4-8f78-5526a3e79c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260ed2c9-72e7-4313-b52c-967e868591a3', 'volume_name': 'volume-260ed2c9-72e7-4313-b52c-967e868591a3', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2342cdcb-47f9-4f8e-9326-609140db2e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2342cdcb-47f9-4f8e-9326-609140db2e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373fb6b8-3caf-4553-bf63-ae5e2eddc540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:41 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Volume 260ed2c9-72e7-4313-b52c-967e868591a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260ed2c9-72e7-4313-b52c-967e868591a3', 'volume_size': 1}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-110946604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260ed2c9-72e7-4313-b52c-967e868591a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a80b46fc784b53b3c1eff464bf1533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:42Z,use_quota=True,user_id='558a5abde0584dcf8b2d6a8b05461b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Creating volume 260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:49:41 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:41 devstack sudo[90147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 1073741824
Apr 13 18:49:41 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:41 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.448s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:41 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Deleted volume successfully.
Apr 13 18:49:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-55ccd4dc-f6e6-4c20-894b-824fecbb890c tempest-VolumeDependencyTests-315519831 None] Lock "cinder-623b145f-4f86-4ec9-b606-f5bcdc640f2a-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:42 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 1073741824" returned: 0 in 0.464s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:42 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3
Apr 13 18:49:42 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:42 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3" returned: 0 in 0.395s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:49:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373fb6b8-3caf-4553-bf63-ae5e2eddc540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260ed2c9-72e7-4313-b52c-967e868591a3', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ac38f6-4997-4a59-be04-7d1bb79b1791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:42 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Volume volume-260ed2c9-72e7-4313-b52c-967e868591a3 (260ed2c9-72e7-4313-b52c-967e868591a3): created successfully
Apr 13 18:49:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ac38f6-4997-4a59-be04-7d1bb79b1791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:42 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Flow 'volume_create_manager' (1e1dfcec-f1d0-4a94-b244-885fcdc8aac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:42 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ab0d2400-668e-4e65-a1b9-5abe75eac2cc tempest-VolumeDependencyTests-315519831 None] Created volume successfully.
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Flow 'volume_create_manager' (878835dd-f264-4f35-9d9d-9a62e3c96b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deac9856-d7bb-4192-acd3-84b0ebf774a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deac9856-d7bb-4192-acd3-84b0ebf774a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-729271910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f478956-2b5d-4a27-bc58-5885efd886ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a80b46fc784b53b3c1eff464bf1533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=260ed2c9-72e7-4313-b52c-967e868591a3,status='creating',terminated_at=None,updated_at=2026-04-13T16:49:43Z,use_quota=True,user_id='558a5abde0584dcf8b2d6a8b05461b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dc7066-9399-401b-ad52-6d7b4322ae50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0dc7066-9399-401b-ad52-6d7b4322ae50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9c7a91-c576-43ac-a818-307962fab85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9c7a91-c576-43ac-a818-307962fab85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6f478956-2b5d-4a27-bc58-5885efd886ae', 'volume_name': 'volume-6f478956-2b5d-4a27-bc58-5885efd886ae', 'volume_size': 1, 'source_volid': '260ed2c9-72e7-4313-b52c-967e868591a3', 'source_volstatus': 'available'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b60c76-ee97-4700-8041-9236a07bcbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b60c76-ee97-4700-8041-9236a07bcbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a363b898-aac4-4a23-9093-c5e5a6ac2ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:43 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Volume 6f478956-2b5d-4a27-bc58-5885efd886ae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6f478956-2b5d-4a27-bc58-5885efd886ae', 'volume_size': 1, 'source_volid': '260ed2c9-72e7-4313-b52c-967e868591a3', 'source_volstatus': 'available'}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:43 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Cloning volume 260ed2c9-72e7-4313-b52c-967e868591a3 to volume 6f478956-2b5d-4a27-bc58-5885efd886ae
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Creating offline snapshot d2e19b80-a3eb-4157-bb33-163510e17858 of volume 260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fdbf13-e1bd-4729-b04c-b24c0439708c]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:43 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3
Apr 13 18:49:43 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:43 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3" returned: 0 in 0.473s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:43 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:43 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 1G
Apr 13 18:49:43 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:44 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 1G" returned: 0 in 0.466s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260ed2c9-72e7-4313-b52c-967e868591a3 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:44 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260ed2c9-72e7-4313-b52c-967e868591a3 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858
Apr 13 18:49:44 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:44 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260ed2c9-72e7-4313-b52c-967e868591a3 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858" returned: 0 in 0.413s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:44 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 is being set with open permissions: ugo+rw
Apr 13 18:49:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:44 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858
Apr 13 18:49:44 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:44 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858" returned: 0 in 0.388s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:45 devstack sudo[90174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.info
Apr 13 18:49:45 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:45 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.info" returned: 0 in 0.423s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:45 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.info is being set with open permissions: ugo+rw
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:45 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.info
Apr 13 18:49:45 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:45 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.info" returned: 0 in 0.390s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-6f478956-2b5d-4a27-bc58-5885efd886ae" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-6f478956-2b5d-4a27-bc58-5885efd886ae" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] snapshot: d2e19b80-a3eb-4157-bb33-163510e17858, volume: 6f478956-2b5d-4a27-bc58-5885efd886ae,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b91bd77-58e9-45ba-81c9-a466abf3ac41]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:45 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858
Apr 13 18:49:45 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:46 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858" returned: 0 in 0.469s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:46 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-260ed2c9-72e7-4313-b52c-967e868591a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:49:46 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:49:46 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:49:46 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baefb9e-4822-4c7d-b302-acbbf2b6774b]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:46 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3
Apr 13 18:49:46 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:46 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3" returned: 0 in 0.473s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:46 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:49:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:46 devstack sudo[90190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae
Apr 13 18:49:46 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:48 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae" returned: 0 in 1.918s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a33c71a-81e9-4fa7-a513-a27b4bbe6d99]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:48 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3
Apr 13 18:49:48 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:49 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3" returned: 0 in 0.588s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:49:49 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Converted 1024.00 MB image at 533.42 MB/s
Apr 13 18:49:49 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae is being set with open permissions: ugo+rw
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:49 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae
Apr 13 18:49:49 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:49 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae" returned: 0 in 0.404s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-6f478956-2b5d-4a27-bc58-5885efd886ae" released by "_copy_volume_from_snapshot" :: held 3.896s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-d2e19b80-a3eb-4157-bb33-163510e17858" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-d2e19b80-a3eb-4157-bb33-163510e17858" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Deleting offline snapshot d2e19b80-a3eb-4157-bb33-163510e17858 of volume 260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] snapshot_file for this snap is: volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[88887421-ce92-4567-bb97-5e5c2833910d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:49 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858
Apr 13 18:49:49 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:50 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858" returned: 0 in 0.469s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-260ed2c9-72e7-4313-b52c-967e868591a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:49:50 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2810f17c-2a7c-4eba-ba20-e50f947f3f45]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:50 devstack sudo[90218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3
Apr 13 18:49:50 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:50 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3" returned: 0 in 0.469s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:50 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858
Apr 13 18:49:50 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:51 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858" returned: 0 in 0.438s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:51 devstack sudo[90228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858
Apr 13 18:49:51 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:51 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3.d2e19b80-a3eb-4157-bb33-163510e17858" returned: 0 in 0.392s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-d2e19b80-a3eb-4157-bb33-163510e17858" released by "_delete_snapshot" :: held 1.814s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.373s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a363b898-aac4-4a23-9093-c5e5a6ac2ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f478956-2b5d-4a27-bc58-5885efd886ae', 'volume_size': 1, 'source_volid': '260ed2c9-72e7-4313-b52c-967e868591a3', 'source_volstatus': 'available'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9a5436-15d4-4f41-9433-3ecef3dc3d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:49:51 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Volume volume-6f478956-2b5d-4a27-bc58-5885efd886ae (6f478956-2b5d-4a27-bc58-5885efd886ae): created successfully
Apr 13 18:49:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9a5436-15d4-4f41-9433-3ecef3dc3d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:49:51 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Flow 'volume_create_manager' (878835dd-f264-4f35-9d9d-9a62e3c96b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:49:51 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-bcab62d4-e4c1-498b-9028-949e611e9ada tempest-VolumeDependencyTests-315519831 None] Created volume successfully.
Apr 13 18:49:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-260ed2c9-72e7-4313-b52c-967e868591a3-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Lock "cinder-260ed2c9-72e7-4313-b52c-967e868591a3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-260ed2c9-72e7-4313-b52c-967e868591a3" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-260ed2c9-72e7-4313-b52c-967e868591a3" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:52 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53dd6ed-ec2e-4382-b3ee-c5ee40b2820a]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:52 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3
Apr 13 18:49:52 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:53 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3" returned: 0 in 0.449s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:53 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3
Apr 13 18:49:53 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:53 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-260ed2c9-72e7-4313-b52c-967e868591a3" returned: 0 in 0.402s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-260ed2c9-72e7-4313-b52c-967e868591a3" released by "delete_volume" :: held 0.877s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Created reservations ['e4efd784-92f1-4313-ae45-d8acaf1c5076', 'c13bd5e0-6d84-4453-a6e0-e3ae0cd29bbc', '4243e3c1-50b2-4c6e-b03e-47f556e64d8d', '33e38870-b763-4c8a-9d91-b887f75bba48'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:53 devstack sudo[90240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:53 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-6f478956-2b5d-4a27-bc58-5885efd886ae-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Lock "cinder-6f478956-2b5d-4a27-bc58-5885efd886ae-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-6f478956-2b5d-4a27-bc58-5885efd886ae" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-6f478956-2b5d-4a27-bc58-5885efd886ae" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[218a62e1-2293-4c46-b766-d19e2b30c42e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:53 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae
Apr 13 18:49:53 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:54 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.432s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:54 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Deleted volume successfully.
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-c113e5dd-9e4f-41c3-b1d4-67da64ef3346 tempest-VolumeDependencyTests-315519831 None] Lock "cinder-260ed2c9-72e7-4313-b52c-967e868591a3-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:54 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae" returned: 0 in 0.470s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:54 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae
Apr 13 18:49:54 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:54 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-6f478956-2b5d-4a27-bc58-5885efd886ae" returned: 0 in 0.401s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-6f478956-2b5d-4a27-bc58-5885efd886ae" released by "delete_volume" :: held 0.893s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Created reservations ['a9a10642-2a96-4fab-a2d4-b3d7d1326b1d', '1987797f-7997-40a4-9040-6c71a98b7811', '1eb40ef9-b72c-474b-9bc2-b45b4f5a8cb6', '1b6f4715-15d4-4e33-96db-8324f6d5340a'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:54 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:54 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-483e8ed6-fa6b-4910-9f83-739a59cffcb0-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Lock "cinder-483e8ed6-fa6b-4910-9f83-739a59cffcb0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Acquiring lock "cinder-quobyte-483e8ed6-fa6b-4910-9f83-739a59cffcb0" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:49:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-483e8ed6-fa6b-4910-9f83-739a59cffcb0" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914b0ab-ff0c-4cde-a361-0ff68389d6aa]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:55 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0
Apr 13 18:49:55 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:55 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.422s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:55 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Deleted volume successfully.
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-38a71884-8697-4012-b537-13f3d80e61f1 tempest-VolumeDependencyTests-315519831 None] Lock "cinder-6f478956-2b5d-4a27-bc58-5885efd886ae-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:55 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0" returned: 0 in 0.456s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:55 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0
Apr 13 18:49:55 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:55 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-483e8ed6-fa6b-4910-9f83-739a59cffcb0" returned: 0 in 0.409s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Lock "cinder-quobyte-483e8ed6-fa6b-4910-9f83-739a59cffcb0" released by "delete_volume" :: held 0.893s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=124,cinder:UPDATE=176,cinder:DELETE=12,cinder:INSERT=41 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=132,cinder:UPDATE=168,cinder:INSERT=43,cinder:DELETE=18 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Created reservations ['d786826c-f68d-43d7-87e4-fbab8660284a', 'b5a0ca23-c283-42bb-b7f6-3a9ba54ccc9b', '4d820e41-933c-41a8-9571-8cf6b52bc7eb', 'aaba9f51-5506-411a-84c4-607e416f2fd1'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:49:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:49:55 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:49:55 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:49:56 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 13 18:49:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.424s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:49:56 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:49:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Deleted volume successfully.
Apr 13 18:49:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3ae775cf-8a3a-4c9e-afc3-cf32a9aeefbb tempest-VolumeDependencyTests-315519831 None] Lock "cinder-483e8ed6-fa6b-4910-9f83-739a59cffcb0-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:00 devstack cinder-volume[82517]: DEBUG oslo_service.periodic_task [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:50:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:00 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:00 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:01 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.450s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Flow 'volume_create_manager' (44155489-24a3-4d50-aad8-9a01113cf8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adff3eb2-a7d1-46ef-bcd0-8fdc5d12c2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adff3eb2-a7d1-46ef-bcd0-8fdc5d12c2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-345554958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c941b9-aac5-4fe7-83e2-805bc16bdec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2c6654496d4551aaf7c08c8e0dd145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:03Z,use_quota=True,user_id='86dc191e4a8b42be80d459480e7d49b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1167c0e3-00d2-4520-9bca-244f3758cc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1167c0e3-00d2-4520-9bca-244f3758cc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a50e4a-7812-49f2-812f-ef7a8073bff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a50e4a-7812-49f2-812f-ef7a8073bff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c941b9-aac5-4fe7-83e2-805bc16bdec2', 'volume_name': 'volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce6e30c-b129-4a12-855a-76ffabf15e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce6e30c-b129-4a12-855a-76ffabf15e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72ea775-f63d-4474-b3ae-60e9b88c8d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Volume a5c941b9-aac5-4fe7-83e2-805bc16bdec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2', 'volume_size': 1}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-345554958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c941b9-aac5-4fe7-83e2-805bc16bdec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2c6654496d4551aaf7c08c8e0dd145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:03Z,use_quota=True,user_id='86dc191e4a8b42be80d459480e7d49b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Creating volume a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:03 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:03 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 1073741824
Apr 13 18:50:03 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (6855f07e-f5d8-4615-b4d3-a5daf8f67ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af511be1-9cc8-4487-9786-0e0d0c16b86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af511be1-9cc8-4487-9786-0e0d0c16b86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1109968534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608c1494-f922-4ff5-ac78-da9f1e8a4d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:03Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a044f0-1f8f-4c28-b7b1-f6140b0747f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a044f0-1f8f-4c28-b7b1-f6140b0747f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42cb2f9-9188-4361-a0e9-3304530e24d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42cb2f9-9188-4361-a0e9-3304530e24d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608c1494-f922-4ff5-ac78-da9f1e8a4d45', 'volume_name': 'volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e4ecd6-8633-4d67-b6da-0ed0e2b0500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e4ecd6-8633-4d67-b6da-0ed0e2b0500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47df5a70-38a8-4c74-a8cf-db2e274d033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Volume 608c1494-f922-4ff5-ac78-da9f1e8a4d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45', 'volume_size': 1}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (7bb19a9a-6cb0-493f-951f-bc1721f53bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90917ae5-fa7a-4056-8185-f334aa07b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90917ae5-fa7a-4056-8185-f334aa07b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-422678169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:03Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca98f4e-49c5-47b8-a76b-61b73640a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca98f4e-49c5-47b8-a76b-61b73640a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf57706-e99c-4a7f-abbd-682ced5b0672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf57706-e99c-4a7f-abbd-682ced5b0672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7', 'volume_name': 'volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7ea87a-4b91-452d-8ce1-6818b3d9fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7ea87a-4b91-452d-8ce1-6818b3d9fad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3887b0a-fb5e-41e9-9292-0a9fe67a14eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Volume f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7', 'volume_size': 1}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (936f9bd4-d834-40f0-996d-c3a1ce31cc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d6d847-5e0b-461d-83ad-3d766a4ed396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d6d847-5e0b-461d-83ad-3d766a4ed396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643650666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6845e32-d4b5-49e6-aead-d21c67217edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:03Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba56ad2-7958-4186-b8d8-af9899394a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba56ad2-7958-4186-b8d8-af9899394a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1475c645-3dcf-4b62-ae53-3f5822c90907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1475c645-3dcf-4b62-ae53-3f5822c90907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6845e32-d4b5-49e6-aead-d21c67217edd', 'volume_name': 'volume-c6845e32-d4b5-49e6-aead-d21c67217edd', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074b7a6f-2e82-4e5e-8642-c1fce485b347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074b7a6f-2e82-4e5e-8642-c1fce485b347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e1212f-5995-48bc-bbf1-6ae659542120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume c6845e32-d4b5-49e6-aead-d21c67217edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6845e32-d4b5-49e6-aead-d21c67217edd', 'volume_size': 1}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (bccdc37d-cbda-4009-b3d1-74494d17ce45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a80292-7d44-46a1-ba17-64b74f24b745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a80292-7d44-46a1-ba17-64b74f24b745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1312902879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3b2412-331b-4d95-912c-166af755b3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:04Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb64256-bfb0-4ee6-8f64-6855c8959374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb64256-bfb0-4ee6-8f64-6855c8959374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4800db0f-0df8-4c75-808d-8d3982f9ffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4800db0f-0df8-4c75-808d-8d3982f9ffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3b2412-331b-4d95-912c-166af755b3e1', 'volume_name': 'volume-5e3b2412-331b-4d95-912c-166af755b3e1', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dcb9e2-836d-44ca-b291-d0f9a41f6332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dcb9e2-836d-44ca-b291-d0f9a41f6332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a940143-5852-49e4-89a2-95ebdde8b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Volume 5e3b2412-331b-4d95-912c-166af755b3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3b2412-331b-4d95-912c-166af755b3e1', 'volume_size': 1}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (90b01030-aa73-4e47-919e-763fcc82b206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbbdc76-2ad9-443b-a3f1-5c9307655143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbbdc76-2ad9-443b-a3f1-5c9307655143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2125864411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8973287-7734-428c-a94b-9a8139de1141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:04Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d57c6e8-e013-4167-bc6a-1de3d0f1e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d57c6e8-e013-4167-bc6a-1de3d0f1e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec2a9aa-964c-47ec-92c7-a1fcff8ba780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec2a9aa-964c-47ec-92c7-a1fcff8ba780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8973287-7734-428c-a94b-9a8139de1141', 'volume_name': 'volume-a8973287-7734-428c-a94b-9a8139de1141', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2417a17f-c944-441e-80d4-f56c1c1a7ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2417a17f-c944-441e-80d4-f56c1c1a7ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b1967b-f13c-4b26-a594-b335d28b43f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:03 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Volume a8973287-7734-428c-a94b-9a8139de1141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8973287-7734-428c-a94b-9a8139de1141', 'volume_size': 1}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:03 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (9984fbdd-86b0-419a-9b5e-d5be6f77e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e117c9-a9ca-41d0-a850-97cfca6256b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e117c9-a9ca-41d0-a850-97cfca6256b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1906452796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6d9bdd-c64d-40aa-b90c-1286efb219ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:04Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5b980a-e385-43b7-b2c6-fe0483e82bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5b980a-e385-43b7-b2c6-fe0483e82bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33df476-4cf0-40e0-b0b2-e6e5cdb18000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33df476-4cf0-40e0-b0b2-e6e5cdb18000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6d9bdd-c64d-40aa-b90c-1286efb219ce', 'volume_name': 'volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36b795a-48d3-44f5-938c-d4459b9a64d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36b795a-48d3-44f5-938c-d4459b9a64d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c81efac-e54b-4b9b-916d-0248cfb51272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:04 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Volume 4f6d9bdd-c64d-40aa-b90c-1286efb219ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce', 'volume_size': 1}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:04 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 1073741824" returned: 0 in 0.855s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:04 devstack sudo[90316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2
Apr 13 18:50:04 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:04 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" returned: 0 in 0.436s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1109968534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608c1494-f922-4ff5-ac78-da9f1e8a4d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:03Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Creating volume 608c1494-f922-4ff5-ac78-da9f1e8a4d45 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:04 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:04 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45 1073741824
Apr 13 18:50:04 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72ea775-f63d-4474-b3ae-60e9b88c8d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c298e74f-c175-46ab-acb0-4d886fbd65c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:04 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Volume volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 (a5c941b9-aac5-4fe7-83e2-805bc16bdec2): created successfully
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c298e74f-c175-46ab-acb0-4d886fbd65c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:04 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Flow 'volume_create_manager' (44155489-24a3-4d50-aad8-9a01113cf8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:04 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-161e7898-9c8a-4114-b0ba-d02f866e8878 tempest-VolumeDependencyTests-421519055 None] Created volume successfully.
Apr 13 18:50:05 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45 1073741824" returned: 0 in 0.551s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:05 devstack sudo[90324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45
Apr 13 18:50:05 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:05 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45" returned: 0 in 0.497s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.139s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-422678169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:03Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Creating volume f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:05 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47df5a70-38a8-4c74-a8cf-db2e274d033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb468d94-2e59-44fa-9dfd-985fee895d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:05 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7 1073741824
Apr 13 18:50:05 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:05 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Volume volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45 (608c1494-f922-4ff5-ac78-da9f1e8a4d45): created successfully
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb468d94-2e59-44fa-9dfd-985fee895d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:05 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (6855f07e-f5d8-4615-b4d3-a5daf8f67ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:05 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-939d4552-ffc9-4a9a-ae21-c7b16c19de54 tempest-CreateVolumesFromImageTest-435477106 None] Created volume successfully.
Apr 13 18:50:06 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7 1073741824" returned: 0 in 0.593s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:06 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7
Apr 13 18:50:06 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:06 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7" returned: 0 in 0.479s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.148s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643650666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6845e32-d4b5-49e6-aead-d21c67217edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:03Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Creating volume c6845e32-d4b5-49e6-aead-d21c67217edd {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:06 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3887b0a-fb5e-41e9-9292-0a9fe67a14eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ae2df6-55f8-4ad8-b49d-8521edfd163c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:06 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd 1073741824
Apr 13 18:50:06 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:06 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Volume volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7 (f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7): created successfully
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ae2df6-55f8-4ad8-b49d-8521edfd163c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:06 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (7bb19a9a-6cb0-493f-951f-bc1721f53bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:06 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4d073f18-68e2-4bd2-9d49-85faf69c6d07 tempest-CreateVolumesFromImageTest-435477106 None] Created volume successfully.
Apr 13 18:50:07 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd 1073741824" returned: 0 in 0.606s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:07 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd
Apr 13 18:50:07 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:07 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd" returned: 0 in 0.468s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.195s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1312902879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3b2412-331b-4d95-912c-166af755b3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:04Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Creating volume 5e3b2412-331b-4d95-912c-166af755b3e1 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:07 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e1212f-5995-48bc-bbf1-6ae659542120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6845e32-d4b5-49e6-aead-d21c67217edd', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957d0ee9-50a6-4735-a9f7-7fbea97fbbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:07 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1 1073741824
Apr 13 18:50:07 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:07 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume volume-c6845e32-d4b5-49e6-aead-d21c67217edd (c6845e32-d4b5-49e6-aead-d21c67217edd): created successfully
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957d0ee9-50a6-4735-a9f7-7fbea97fbbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:07 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (936f9bd4-d834-40f0-996d-c3a1ce31cc3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:07 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-303b4190-1cee-4b31-9877-bb377c72accb tempest-CreateVolumesFromSnapshotTest-617215783 None] Created volume successfully.
Apr 13 18:50:08 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1 1073741824" returned: 0 in 0.553s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:08 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1
Apr 13 18:50:08 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:08 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1" returned: 0 in 0.455s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.095s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2125864411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8973287-7734-428c-a94b-9a8139de1141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:04Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Creating volume a8973287-7734-428c-a94b-9a8139de1141 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:08 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a940143-5852-49e4-89a2-95ebdde8b495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3b2412-331b-4d95-912c-166af755b3e1', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:08 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141 1073741824
Apr 13 18:50:08 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefa0599-44b8-437a-ab74-8bf0d528aae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:08 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Volume volume-5e3b2412-331b-4d95-912c-166af755b3e1 (5e3b2412-331b-4d95-912c-166af755b3e1): created successfully
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefa0599-44b8-437a-ab74-8bf0d528aae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:08 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (bccdc37d-cbda-4009-b3d1-74494d17ce45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:08 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-0b04921a-08a4-4eb0-9242-7b8c07950d9f tempest-CreateVolumesFromImageTest-435477106 None] Created volume successfully.
Apr 13 18:50:09 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141 1073741824" returned: 0 in 0.575s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:09 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:09 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141
Apr 13 18:50:09 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:10 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141" returned: 0 in 0.504s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.956s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1906452796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6d9bdd-c64d-40aa-b90c-1286efb219ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f143dbf3814e421eb8e2bd82820d48cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:04Z,use_quota=True,user_id='668416afc4784316b66be8095ad577b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Creating volume 4f6d9bdd-c64d-40aa-b90c-1286efb219ce {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:10 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b1967b-f13c-4b26-a594-b335d28b43f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8973287-7734-428c-a94b-9a8139de1141', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:10 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce 1073741824
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11986c3-cb2c-4a77-8e54-d477d6052a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:10 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:10 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Volume volume-a8973287-7734-428c-a94b-9a8139de1141 (a8973287-7734-428c-a94b-9a8139de1141): created successfully
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11986c3-cb2c-4a77-8e54-d477d6052a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (90b01030-aa73-4e47-919e-763fcc82b206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:10 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-04739dc8-aa4c-4c12-b940-7eaeb0c7ebbb tempest-CreateVolumesFromImageTest-435477106 None] Created volume successfully.
Apr 13 18:50:10 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce 1073741824" returned: 0 in 0.617s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:10 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:10 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce
Apr 13 18:50:10 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:11 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.880s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c81efac-e54b-4b9b-916d-0248cfb51272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81972387-508d-4d53-bf47-3d1e32bec358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Creating offline snapshot 8390f71b-7577-47fb-a904-edf00e9116c0 of volume a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:50:11 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Volume volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce (4f6d9bdd-c64d-40aa-b90c-1286efb219ce): created successfully
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81972387-508d-4d53-bf47-3d1e32bec358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Flow 'volume_create_manager' (9984fbdd-86b0-419a-9b5e-d5be6f77e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d49600-dd91-451f-9409-fcf06866029d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:11 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-618750a5-8386-44d9-a2c6-99ef1535cd86 tempest-CreateVolumesFromImageTest-435477106 None] Created volume successfully.
Apr 13 18:50:11 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2
Apr 13 18:50:11 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-4f6d9bdd-c64d-40aa-b90c-1286efb219ce-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-4f6d9bdd-c64d-40aa-b90c-1286efb219ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-quobyte-4f6d9bdd-c64d-40aa-b90c-1286efb219ce" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-4f6d9bdd-c64d-40aa-b90c-1286efb219ce" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40d4e4a-813b-4684-a5a8-0b816f21d0c4]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:11 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" returned: 0 in 0.522s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:11 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:11 devstack sudo[90374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 1G
Apr 13 18:50:11 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:11 devstack sudo[90373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce
Apr 13 18:50:11 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:12 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce" returned: 0 in 0.533s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:12 devstack sudo[90383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce
Apr 13 18:50:12 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:12 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 1G" returned: 0 in 0.557s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:12 devstack sudo[90385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0
Apr 13 18:50:12 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:12 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-4f6d9bdd-c64d-40aa-b90c-1286efb219ce" returned: 0 in 0.431s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-4f6d9bdd-c64d-40aa-b90c-1286efb219ce" released by "delete_volume" :: held 0.997s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Created reservations ['8d9f8d2a-c390-4248-afd4-66888d5a4afa', 'f61277d9-f13d-459b-8878-39c1a91685fe', 'd4a8efd1-75a4-4edd-b523-a8a468ff18d4', 'e419dc07-5400-4abe-9fb2-9e6dc3f3b3f6'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:12 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0" returned: 0 in 0.441s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:12 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 is being set with open permissions: ugo+rw
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:12 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0
Apr 13 18:50:12 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:12 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:12 devstack sudo[90393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:12 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:13 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0" returned: 0 in 0.410s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:13 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.info
Apr 13 18:50:13 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:13 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.515s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:13 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Deleted volume successfully.
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f0181a5e-a143-4fa0-977d-1c5810d9da50 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-4f6d9bdd-c64d-40aa-b90c-1286efb219ce-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:13 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.info" returned: 0 in 0.454s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:13 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.info is being set with open permissions: ugo+rw
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:13 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.info
Apr 13 18:50:13 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-a8973287-7734-428c-a94b-9a8139de1141-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-a8973287-7734-428c-a94b-9a8139de1141-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-quobyte-a8973287-7734-428c-a94b-9a8139de1141" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-a8973287-7734-428c-a94b-9a8139de1141" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[69930a8a-a781-4b35-8e10-c8c3cd836d61]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:13 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:13 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141
Apr 13 18:50:13 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:14 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.info" returned: 0 in 0.509s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.973s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.225s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Creating offline snapshot 468290c7-1696-4966-a45e-3868559e3f3e of volume c6845e32-d4b5-49e6-aead-d21c67217edd {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:50:14 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e20c9029-8042-43e0-9629-65312424acf0 tempest-VolumeDependencyTests-421519055 None] Create snapshot completed successfully
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[095d2567-2361-48d0-889e-dcd2fe665812]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:14 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd
Apr 13 18:50:14 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:14 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141" returned: 0 in 0.546s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:14 devstack sudo[90417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141
Apr 13 18:50:14 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:14 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd" returned: 0 in 0.570s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:14 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e 1G
Apr 13 18:50:14 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:14 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8973287-7734-428c-a94b-9a8139de1141" returned: 0 in 0.512s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-a8973287-7734-428c-a94b-9a8139de1141" released by "delete_volume" :: held 1.086s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Flow 'volume_create_manager' (7a323699-b8de-42f0-bc2b-4b552eee61ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:14 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3aa10b-e972-4b4f-9639-1c6ae222f5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3aa10b-e972-4b4f-9639-1c6ae222f5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1545100247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d2f835-1127-4cba-a870-766cbce7409c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2c6654496d4551aaf7c08c8e0dd145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8390f71b-7577-47fb-a904-edf00e9116c0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:15Z,use_quota=True,user_id='86dc191e4a8b42be80d459480e7d49b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507915e0-1edc-4b40-9d8b-c4ff82a8ea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507915e0-1edc-4b40-9d8b-c4ff82a8ea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3446675-17d2-44e4-b5e2-4ff8ee9c1d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3446675-17d2-44e4-b5e2-4ff8ee9c1d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89d2f835-1127-4cba-a870-766cbce7409c', 'volume_name': 'volume-89d2f835-1127-4cba-a870-766cbce7409c', 'volume_size': 1, 'snapshot_id': '8390f71b-7577-47fb-a904-edf00e9116c0'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca15e4e6-ad96-48c9-b5a0-db84e8896bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca15e4e6-ad96-48c9-b5a0-db84e8896bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e4ec88-1f86-429f-ace0-331f7443df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:15 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Volume 89d2f835-1127-4cba-a870-766cbce7409c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89d2f835-1127-4cba-a870-766cbce7409c', 'volume_size': 1, 'snapshot_id': '8390f71b-7577-47fb-a904-edf00e9116c0'}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Created reservations ['678de13f-8ee3-4fe2-b835-c194043d89be', '4ad7df42-239f-4bf8-9e16-163eaf5c320b', '7a2de2e6-2def-45aa-bc96-e6017e786874', 'c9661db9-cb6c-4334-ad13-22195cc6f03a'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:15 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:15 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:15 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e 1G" returned: 0 in 0.647s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6845e32-d4b5-49e6-aead-d21c67217edd -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:15 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6845e32-d4b5-49e6-aead-d21c67217edd -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e
Apr 13 18:50:15 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:15 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.527s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:15 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Deleted volume successfully.
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-2919ac0e-c859-4398-8f0e-6f2c59f75c61 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-a8973287-7734-428c-a94b-9a8139de1141-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:15 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6845e32-d4b5-49e6-aead-d21c67217edd -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e" returned: 0 in 0.490s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:15 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e is being set with open permissions: ugo+rw
Apr 13 18:50:15 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:15 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e
Apr 13 18:50:15 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-5e3b2412-331b-4d95-912c-166af755b3e1-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-5e3b2412-331b-4d95-912c-166af755b3e1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-quobyte-5e3b2412-331b-4d95-912c-166af755b3e1" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-5e3b2412-331b-4d95-912c-166af755b3e1" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcfa451-fd48-4e9a-b933-8be522608ed7]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:16 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1
Apr 13 18:50:16 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:16 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e" returned: 0 in 0.441s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:16 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.info
Apr 13 18:50:16 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:16 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1" returned: 0 in 0.589s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:16 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1
Apr 13 18:50:16 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:16 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.info" returned: 0 in 0.461s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:16 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.info is being set with open permissions: ugo+rw
Apr 13 18:50:16 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:16 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.info
Apr 13 18:50:16 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:17 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5e3b2412-331b-4d95-912c-166af755b3e1" returned: 0 in 0.526s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-5e3b2412-331b-4d95-912c-166af755b3e1" released by "delete_volume" :: held 1.150s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Created reservations ['e338a030-5f56-4049-b78b-61323f5ea8b3', 'af37bc75-9a01-4cc0-bd30-b98c56e7912e', 'f21d2abf-c0df-4a0c-bd8d-26c416ccd876', 'f5525297-4a85-42eb-90cd-d3b9eccd43e3'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:17 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.info" returned: 0 in 0.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:17 devstack sudo[90453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:17 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.144s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.264s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-8390f71b-7577-47fb-a904-edf00e9116c0-89d2f835-1127-4cba-a870-766cbce7409c" by "_create_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-8390f71b-7577-47fb-a904-edf00e9116c0-89d2f835-1127-4cba-a870-766cbce7409c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Creating volume 89d2f835-1127-4cba-a870-766cbce7409c from snapshot 8390f71b-7577-47fb-a904-edf00e9116c0 {{(pid=82517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-89d2f835-1127-4cba-a870-766cbce7409c" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-89d2f835-1127-4cba-a870-766cbce7409c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] snapshot: 8390f71b-7577-47fb-a904-edf00e9116c0, volume: 89d2f835-1127-4cba-a870-766cbce7409c,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:50:17 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ba5d26fd-023c-492b-a4b0-1cbc90304ace tempest-CreateVolumesFromSnapshotTest-617215783 None] Create snapshot completed successfully
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7b2ab8-1d60-47ec-a0d3-2b40b9358ef0]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:17 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0
Apr 13 18:50:17 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:17 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.434s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:17 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Deleted volume successfully.
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-95ca1640-f86f-4ff3-ac69-794ab6a9723b tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-5e3b2412-331b-4d95-912c-166af755b3e1-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:17 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0" returned: 0 in 0.546s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2e04b9-c93a-45ef-b62a-72726c7eefce]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:17 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:18 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2
Apr 13 18:50:18 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-quobyte-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb46cb04-468b-495c-b787-1a678b4edae0]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:18 devstack sudo[90463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7
Apr 13 18:50:18 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (2e171f7f-eece-4241-a545-6754c3fe81aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459dcc6a-b53b-483d-87c8-33a72e27f8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459dcc6a-b53b-483d-87c8-33a72e27f8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358161436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9d0b1e-d389-4857-ba35-67d92435b259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:18Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787d4f96-5e8f-41b7-9bb7-c20cbdaffde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787d4f96-5e8f-41b7-9bb7-c20cbdaffde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc103643-ccde-4e6e-99d2-47dcc25262c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc103643-ccde-4e6e-99d2-47dcc25262c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb9d0b1e-d389-4857-ba35-67d92435b259', 'volume_name': 'volume-bb9d0b1e-d389-4857-ba35-67d92435b259', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3995701-3b10-49a7-913d-1081bc8a96b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3995701-3b10-49a7-913d-1081bc8a96b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413c39e2-e089-4f74-8147-c743e739c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume bb9d0b1e-d389-4857-ba35-67d92435b259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb9d0b1e-d389-4857-ba35-67d92435b259', 'volume_size': 1}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:18 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" returned: 0 in 0.682s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:18 devstack sudo[90468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c
Apr 13 18:50:18 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (9c1a94ab-ccfd-40e6-9dc6-0646c3d1fa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec34188-b744-486e-900e-95a035b19088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec34188-b744-486e-900e-95a035b19088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-771651506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea64994b-ea20-4379-b462-c45f47de5cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:19Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec3d096-4b0e-4acd-83a5-b89e7c21dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec3d096-4b0e-4acd-83a5-b89e7c21dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdb4790-0fa2-49df-badf-5ceefe8905eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdb4790-0fa2-49df-badf-5ceefe8905eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea64994b-ea20-4379-b462-c45f47de5cf3', 'volume_name': 'volume-ea64994b-ea20-4379-b462-c45f47de5cf3', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ba745c-6661-4219-ae7f-4dead3a2952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ba745c-6661-4219-ae7f-4dead3a2952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89ce010-3e7d-453c-96b2-1148c94d1d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:18 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume ea64994b-ea20-4379-b462-c45f47de5cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea64994b-ea20-4379-b462-c45f47de5cf3', 'volume_size': 1}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:18 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (e8c1dfff-6908-46f0-913d-7e4f46b00807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c5adaa-677c-4132-bde3-74788505a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c5adaa-677c-4132-bde3-74788505a371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1160039320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8aa45d0-fde0-41f4-a024-aebd1a62f64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:19Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fe5df5-89c4-49ba-9c64-06ec53dd6269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fe5df5-89c4-49ba-9c64-06ec53dd6269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10f58bd-34cc-4068-870e-51bf63b04254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f10f58bd-34cc-4068-870e-51bf63b04254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8aa45d0-fde0-41f4-a024-aebd1a62f64f', 'volume_name': 'volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a26184-87f3-4070-909f-ffd1b79b828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a26184-87f3-4070-909f-ffd1b79b828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dc4b9d-5081-4ac6-8a1c-19cb7ec51834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume a8aa45d0-fde0-41f4-a024-aebd1a62f64f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f', 'volume_size': 1}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:19 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7" returned: 0 in 0.857s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:19 devstack sudo[90473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7
Apr 13 18:50:19 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (261c3c4b-e268-4624-ae15-6ddcc87a6b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8010c3-afb2-4182-9297-f4f7ac7350c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8010c3-afb2-4182-9297-f4f7ac7350c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1530143209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57179ae-5db2-4c8f-8eab-bde0d2253dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:19Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a3933a-46e6-464d-a29b-ef9d72391957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a3933a-46e6-464d-a29b-ef9d72391957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2718d2ad-093b-4ed9-9fd5-b5495e52c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2718d2ad-093b-4ed9-9fd5-b5495e52c78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57179ae-5db2-4c8f-8eab-bde0d2253dc9', 'volume_name': 'volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14bfd20-e7d2-4800-908c-317ceba7f3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14bfd20-e7d2-4800-908c-317ceba7f3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1220bd85-0925-44a0-8382-1e6d10fcd5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume f57179ae-5db2-4c8f-8eab-bde0d2253dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9', 'volume_size': 1}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (99f27545-7e83-4c9d-84a3-93d72e4aec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0154c5c-c0a8-48eb-8acf-a0da54bc87ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0154c5c-c0a8-48eb-8acf-a0da54bc87ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-265194630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650941ba-5384-462e-af56-e5f7cfcabdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:19Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f72f85-1764-4652-a163-9b082830a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f72f85-1764-4652-a163-9b082830a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970380f5-5c56-44cc-82ff-81926d4898ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970380f5-5c56-44cc-82ff-81926d4898ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650941ba-5384-462e-af56-e5f7cfcabdf5', 'volume_name': 'volume-650941ba-5384-462e-af56-e5f7cfcabdf5', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a30a81c-24fb-45a0-9924-2e5aada64817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a30a81c-24fb-45a0-9924-2e5aada64817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923a4aeb-6c0b-425c-9da2-9515a306b850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:19 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume 650941ba-5384-462e-af56-e5f7cfcabdf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650941ba-5384-462e-af56-e5f7cfcabdf5', 'volume_size': 1}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:19 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Flow 'volume_create_manager' (328093ed-350b-46fa-aa1e-d725236b9e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:19 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629d6418-ef45-4f77-a6ca-1391a08e2b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7" returned: 0 in 0.866s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629d6418-ef45-4f77-a6ca-1391a08e2b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1907118348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd48d040-894a-44ac-b579-58192c6d1266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d29f0a7e7354c888133055a8c5ddec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:20Z,use_quota=True,user_id='4a5de35e0e80420e9e2e97c7d067e6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4fee13-32f1-40e3-884a-ae17fb2cf292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4fee13-32f1-40e3-884a-ae17fb2cf292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9a5a3e-ca98-4188-a383-ceac0ad7bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9a5a3e-ca98-4188-a383-ceac0ad7bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd48d040-894a-44ac-b579-58192c6d1266', 'volume_name': 'volume-fd48d040-894a-44ac-b579-58192c6d1266', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5646154-21e5-4bc6-b317-f77f98895d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5646154-21e5-4bc6-b317-f77f98895d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6e48ec-26bd-4b47-a02c-2fe6aa3f1f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:20 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Volume fd48d040-894a-44ac-b579-58192c6d1266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd48d040-894a-44ac-b579-58192c6d1266', 'volume_size': 1}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7" released by "delete_volume" :: held 1.834s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Created reservations ['5cc4360c-dc0f-4f3c-95e2-28d651c5dba6', 'c047b23c-fbc0-4a95-b841-cc3faeb4e0b2', '0856a247-40bb-4a0f-9325-91e5775eee0c', 'dccbb5a0-0cae-4420-a441-dd8d93fdffa6'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:20 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:20 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-608c1494-f922-4ff5-ac78-da9f1e8a4d45-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-608c1494-f922-4ff5-ac78-da9f1e8a4d45-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "cinder-quobyte-608c1494-f922-4ff5-ac78-da9f1e8a4d45" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-608c1494-f922-4ff5-ac78-da9f1e8a4d45" acquired by "delete_volume" :: waited 0.025s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[722d3820-ad0b-4e1f-bf3e-af78980c84ab]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:20 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:21 devstack sudo[90496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45
Apr 13 18:50:21 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:21 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 1.002s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:21 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Deleted volume successfully.
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4b582763-9a46-47f4-a41b-3f2f5e50da54 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-f38ec5a6-efb9-4a97-a13a-6f8b10ec46f7-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:21 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c" returned: 0 in 2.682s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7526fe74-7b53-4823-b2f0-ea0b20fab5f1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:21 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2
Apr 13 18:50:21 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:21 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45" returned: 0 in 0.857s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:21 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45
Apr 13 18:50:21 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:21 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" returned: 0 in 0.613s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2, size 1024.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:50:21 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Converted 1024.00 MB image at 381.75 MB/s
Apr 13 18:50:21 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c is being set with open permissions: ugo+rw
Apr 13 18:50:21 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:21 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c
Apr 13 18:50:21 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:22 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-608c1494-f922-4ff5-ac78-da9f1e8a4d45" returned: 0 in 0.420s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-quobyte-608c1494-f922-4ff5-ac78-da9f1e8a4d45" released by "delete_volume" :: held 1.316s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Created reservations ['8d8d1cc0-164e-4883-90bf-8771efc68f61', '69079349-186e-4050-9ab9-e7e34a7b19b7', '085790e8-b4c7-4a00-97a9-131f4ec1fd40', 'af30162c-c6f3-4af4-929e-2936c43031fd'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:22 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:22 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:22 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c" returned: 0 in 0.435s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-89d2f835-1127-4cba-a870-766cbce7409c" released by "_copy_volume_from_snapshot" :: held 5.038s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-8390f71b-7577-47fb-a904-edf00e9116c0-89d2f835-1127-4cba-a870-766cbce7409c" released by "_create_volume_from_snapshot" :: held 5.062s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.080s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.846s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358161436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9d0b1e-d389-4857-ba35-67d92435b259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:18Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Creating volume bb9d0b1e-d389-4857-ba35-67d92435b259 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:22 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:22 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259 1073741824
Apr 13 18:50:22 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e4ec88-1f86-429f-ace0-331f7443df1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d2f835-1127-4cba-a870-766cbce7409c', 'volume_size': 1, 'snapshot_id': '8390f71b-7577-47fb-a904-edf00e9116c0'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7c841c-7f6b-46d2-8077-e1eb1dc1d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:22 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Volume volume-89d2f835-1127-4cba-a870-766cbce7409c (89d2f835-1127-4cba-a870-766cbce7409c): created successfully
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7c841c-7f6b-46d2-8077-e1eb1dc1d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Flow 'volume_create_manager' (7a323699-b8de-42f0-bc2b-4b552eee61ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e65e612f-6f66-49cb-a6c0-d2e30f7930f6 tempest-VolumeDependencyTests-421519055 None] Created volume successfully.
Apr 13 18:50:22 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.431s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:22 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Deleted volume successfully.
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-df3ff7a9-c697-410d-8b08-8f25df9a99e3 tempest-CreateVolumesFromImageTest-435477106 None] Lock "cinder-608c1494-f922-4ff5-ac78-da9f1e8a4d45-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:22 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259 1073741824" returned: 0 in 0.522s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:22 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:22 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259
Apr 13 18:50:22 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-8390f71b-7577-47fb-a904-edf00e9116c0-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Lock "cinder-8390f71b-7577-47fb-a904-edf00e9116c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-8390f71b-7577-47fb-a904-edf00e9116c0" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:23 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259" returned: 0 in 0.506s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.637s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-771651506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea64994b-ea20-4379-b462-c45f47de5cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:19Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Creating volume ea64994b-ea20-4379-b462-c45f47de5cf3 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:23 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-8390f71b-7577-47fb-a904-edf00e9116c0" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Deleting offline snapshot 8390f71b-7577-47fb-a904-edf00e9116c0 of volume a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] snapshot_file for this snap is: volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:50:23 devstack sudo[90559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3 1073741824
Apr 13 18:50:23 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413c39e2-e089-4f74-8147-c743e739c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9d0b1e-d389-4857-ba35-67d92435b259', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90be94b8-0c08-455f-a536-205b5c10ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4c4bcc-4b72-4ac8-9056-9c4b52aebc96]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:23 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume volume-bb9d0b1e-d389-4857-ba35-67d92435b259 (bb9d0b1e-d389-4857-ba35-67d92435b259): created successfully
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90be94b8-0c08-455f-a536-205b5c10ff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:23 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (2e171f7f-eece-4241-a545-6754c3fe81aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:23 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ff78129f-cfc9-4cf4-b638-8831f08b3fa3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Created volume successfully.
Apr 13 18:50:23 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0
Apr 13 18:50:23 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:24 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3 1073741824" returned: 0 in 0.572s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:24 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0" returned: 0 in 0.573s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:50:24 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3
Apr 13 18:50:24 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08470f1-fab7-4eb8-a3ad-4437955cc7a6]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:24 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2
Apr 13 18:50:24 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:24 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3" returned: 0 in 0.504s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.488s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1160039320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8aa45d0-fde0-41f4-a024-aebd1a62f64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:19Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Creating volume a8aa45d0-fde0-41f4-a024-aebd1a62f64f {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:24 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:24 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f 1073741824
Apr 13 18:50:24 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89ce010-3e7d-453c-96b2-1148c94d1d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea64994b-ea20-4379-b462-c45f47de5cf3', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2a5543-7737-45d2-b559-bad28b08b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:24 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume volume-ea64994b-ea20-4379-b462-c45f47de5cf3 (ea64994b-ea20-4379-b462-c45f47de5cf3): created successfully
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2a5543-7737-45d2-b559-bad28b08b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (9c1a94ab-ccfd-40e6-9dc6-0646c3d1fa24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:24 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (0c149d83-708b-411c-8791-f706531385c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de44dbab-d3a2-4bf7-aa32-8c9d3b064318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" returned: 0 in 0.566s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:24 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-35ab5609-b6e7-42db-b20c-8b0bb57f1eac tempest-CreateVolumesFromSnapshotTest-617215783 None] Created volume successfully.
Apr 13 18:50:24 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0
Apr 13 18:50:24 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de44dbab-d3a2-4bf7-aa32-8c9d3b064318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891430509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50d41a8-c85b-4d50-b830-81ca5a52188e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:25Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4f85ed-5c53-4058-bb4a-7258e834f2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4f85ed-5c53-4058-bb4a-7258e834f2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b99d3a-8c33-4db7-b4a9-779e06d487ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b99d3a-8c33-4db7-b4a9-779e06d487ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50d41a8-c85b-4d50-b830-81ca5a52188e', 'volume_name': 'volume-d50d41a8-c85b-4d50-b830-81ca5a52188e', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e714fc-7ac7-4a3d-8fa4-1a448faea01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e714fc-7ac7-4a3d-8fa4-1a448faea01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493f830e-0342-4c9d-8c38-06becc4462ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:24 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume d50d41a8-c85b-4d50-b830-81ca5a52188e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50d41a8-c85b-4d50-b830-81ca5a52188e', 'volume_size': 1}
Apr 13 18:50:24 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:25 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f 1073741824" returned: 0 in 0.491s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:25 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f
Apr 13 18:50:25 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:25 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0" returned: 0 in 0.477s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:25 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0
Apr 13 18:50:25 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:25 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f" returned: 0 in 0.408s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.132s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1530143209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57179ae-5db2-4c8f-8eab-bde0d2253dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:19Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Creating volume f57179ae-5db2-4c8f-8eab-bde0d2253dc9 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:25 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dc4b9d-5081-4ac6-8a1c-19cb7ec51834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41536f8-dd5a-4e02-9291-1bce79114bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:25 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9 1073741824
Apr 13 18:50:25 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:25 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f (a8aa45d0-fde0-41f4-a024-aebd1a62f64f): created successfully
Apr 13 18:50:25 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41536f8-dd5a-4e02-9291-1bce79114bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (e8c1dfff-6908-46f0-913d-7e4f46b00807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2.8390f71b-7577-47fb-a904-edf00e9116c0" returned: 0 in 0.414s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:25 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-13ad2576-18f8-4f27-86a8-c8cf689ff6a7 tempest-CreateVolumesFromSnapshotTest-617215783 None] Created volume successfully.
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-8390f71b-7577-47fb-a904-edf00e9116c0" released by "_delete_snapshot" :: held 2.121s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" released by "delete_snapshot" :: held 2.163s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Created reservations ['fcf199c9-47ad-49ec-aacd-824e9bb61f5d', '05501101-20e0-4b7a-bb40-bba97116d7db', 'f49ad842-d8a5-4e68-8ff8-313fa9af6372', '5fd393c5-bfde-4bbb-ade6-8759c471013f'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:25 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Delete snapshot completed successfully.
Apr 13 18:50:25 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f9960f74-e7cc-40fe-a812-150fe183c09e tempest-VolumeDependencyTests-421519055 None] Lock "cinder-8390f71b-7577-47fb-a904-edf00e9116c0-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:26 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9 1073741824" returned: 0 in 0.492s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:26 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9
Apr 13 18:50:26 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:26 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9" returned: 0 in 0.420s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.887s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-265194630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650941ba-5384-462e-af56-e5f7cfcabdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a187ef39485f418abc8f4a5bbc388ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:19Z,use_quota=True,user_id='3ae6ac9cd9c44aee97bf8a244c4bfa8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Creating volume 650941ba-5384-462e-af56-e5f7cfcabdf5 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:26 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1220bd85-0925-44a0-8382-1e6d10fcd5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e0d660-e225-4c6a-8bdb-3c12087de19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:26 devstack sudo[90602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5 1073741824
Apr 13 18:50:26 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:26 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9 (f57179ae-5db2-4c8f-8eab-bde0d2253dc9): created successfully
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e0d660-e225-4c6a-8bdb-3c12087de19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (261c3c4b-e268-4624-ae15-6ddcc87a6b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:26 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3c7827e9-719e-42cd-8559-e2b9524d64e3 tempest-CreateVolumesFromSnapshotTest-617215783 None] Created volume successfully.
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-a5c941b9-aac5-4fe7-83e2-805bc16bdec2-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-a5c941b9-aac5-4fe7-83e2-805bc16bdec2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b587e798-f817-485c-a286-e1bf9cc32650]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:26 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2
Apr 13 18:50:26 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:26 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:26 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5 1073741824" returned: 0 in 0.489s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:27 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5
Apr 13 18:50:27 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:27 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" returned: 0 in 0.487s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:27 devstack sudo[90614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2
Apr 13 18:50:27 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:27 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5" returned: 0 in 0.421s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.346s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1907118348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd48d040-894a-44ac-b579-58192c6d1266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d29f0a7e7354c888133055a8c5ddec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:20Z,use_quota=True,user_id='4a5de35e0e80420e9e2e97c7d067e6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Creating volume fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:27 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923a4aeb-6c0b-425c-9da2-9515a306b850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650941ba-5384-462e-af56-e5f7cfcabdf5', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b23eae5-ff17-41cc-a3f3-0d46f52912e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:27 devstack sudo[90617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 1073741824
Apr 13 18:50:27 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:27 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Volume volume-650941ba-5384-462e-af56-e5f7cfcabdf5 (650941ba-5384-462e-af56-e5f7cfcabdf5): created successfully
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b23eae5-ff17-41cc-a3f3-0d46f52912e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Flow 'volume_create_manager' (99f27545-7e83-4c9d-84a3-93d72e4aec41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:27 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-dd7e4183-2559-4e8d-97ed-53fda94f8f2d tempest-CreateVolumesFromSnapshotTest-617215783 None] Created volume successfully.
Apr 13 18:50:27 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" returned: 0 in 0.431s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-a5c941b9-aac5-4fe7-83e2-805bc16bdec2" released by "delete_volume" :: held 0.946s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Created reservations ['cf8b43db-c255-44ad-b59b-c1db0dcdcf92', '3690a024-e2be-4326-bf90-bd1329bdaf58', 'fb9d163c-834e-44d0-8e89-da22b3453819', 'ecabb7dd-1111-4f04-a577-9c6fbeb1853d'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:27 devstack sudo[90620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:27 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Flow 'volume_create_manager' (297b7db5-6b37-4b28-af13-d9fac6f0c704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2383bc14-f11a-4af8-ac21-1ace66fd2757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2383bc14-f11a-4af8-ac21-1ace66fd2757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1360067621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2c6654496d4551aaf7c08c8e0dd145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:28Z,use_quota=True,user_id='86dc191e4a8b42be80d459480e7d49b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72248778-2ca5-4e40-86fd-35304994a04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:27 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72248778-2ca5-4e40-86fd-35304994a04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b165516-6492-43d9-93da-bb7dd89d3249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b165516-6492-43d9-93da-bb7dd89d3249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b', 'volume_name': 'volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:27 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6135ad-60c4-495f-a9b9-99c5963ec6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6135ad-60c4-495f-a9b9-99c5963ec6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3cc20a-de1a-4ffb-9d30-f02b090bb54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:28 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Volume f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b', 'volume_size': 1}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 1073741824" returned: 0 in 0.567s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:28 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266
Apr 13 18:50:28 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:28 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.496s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Deleted volume successfully.
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-650941ba-5384-462e-af56-e5f7cfcabdf5-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-097eacad-5baa-4c1b-9019-92020fdfba71 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-a5c941b9-aac5-4fe7-83e2-805bc16bdec2-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-650941ba-5384-462e-af56-e5f7cfcabdf5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-quobyte-650941ba-5384-462e-af56-e5f7cfcabdf5" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-650941ba-5384-462e-af56-e5f7cfcabdf5" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b5408-46c4-4221-b30a-627d7321ae20]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:28 devstack sudo[90628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5
Apr 13 18:50:28 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:28 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266" returned: 0 in 0.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.749s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891430509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50d41a8-c85b-4d50-b830-81ca5a52188e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:25Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Creating volume d50d41a8-c85b-4d50-b830-81ca5a52188e {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:28 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6e48ec-26bd-4b47-a02c-2fe6aa3f1f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd48d040-894a-44ac-b579-58192c6d1266', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:28 devstack sudo[90631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e 1073741824
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d0c465-63f6-425b-9b14-ef5601bd36ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:28 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:28 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Volume volume-fd48d040-894a-44ac-b579-58192c6d1266 (fd48d040-894a-44ac-b579-58192c6d1266): created successfully
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d0c465-63f6-425b-9b14-ef5601bd36ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Flow 'volume_create_manager' (328093ed-350b-46fa-aa1e-d725236b9e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:28 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f0e203bf-0caa-49f8-8159-2c7736f1df82 tempest-SnapshotDependencyTests-627672191 None] Created volume successfully.
Apr 13 18:50:28 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5" returned: 0 in 0.487s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:28 devstack sudo[90636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5
Apr 13 18:50:28 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:28 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:28 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e 1073741824" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:29 devstack sudo[90641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e
Apr 13 18:50:29 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:29 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-650941ba-5384-462e-af56-e5f7cfcabdf5" returned: 0 in 0.422s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-650941ba-5384-462e-af56-e5f7cfcabdf5" released by "delete_volume" :: held 0.928s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Created reservations ['fb8fde67-bb7b-4399-a700-18eb0a83651d', 'e9ed5723-c7f8-495f-afe0-292ab413bddc', 'a3db5a21-6f85-41da-97b8-923f16e15406', '0269023b-7fd2-4af6-9b3c-5653c05ff0cd'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:29 devstack sudo[90644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:29 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-f57179ae-5db2-4c8f-8eab-bde0d2253dc9-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-f57179ae-5db2-4c8f-8eab-bde0d2253dc9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-quobyte-f57179ae-5db2-4c8f-8eab-bde0d2253dc9" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-f57179ae-5db2-4c8f-8eab-bde0d2253dc9" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d5ab81-930a-4f76-b4ae-ac73b3af60e5]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:29 devstack sudo[90646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9
Apr 13 18:50:29 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:29 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e" returned: 0 in 0.421s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.435s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1360067621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2c6654496d4551aaf7c08c8e0dd145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:28Z,use_quota=True,user_id='86dc191e4a8b42be80d459480e7d49b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Creating volume f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:29 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493f830e-0342-4c9d-8c38-06becc4462ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50d41a8-c85b-4d50-b830-81ca5a52188e', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577497ff-177b-4e43-bb70-f017bc44c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:29 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume volume-d50d41a8-c85b-4d50-b830-81ca5a52188e (d50d41a8-c85b-4d50-b830-81ca5a52188e): created successfully
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577497ff-177b-4e43-bb70-f017bc44c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (0c149d83-708b-411c-8791-f706531385c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:29 devstack sudo[90649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b 1073741824
Apr 13 18:50:29 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:29 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f2e1353c-ef63-472b-8dc5-04a90439bbdf tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created volume successfully.
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:29 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.511s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:29 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Deleted volume successfully.
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-ba1792c7-134e-496d-bb0a-ccf1f0cdc768 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-650941ba-5384-462e-af56-e5f7cfcabdf5-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:29 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9" returned: 0 in 0.494s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:29 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:29 devstack sudo[90655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9
Apr 13 18:50:29 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:30 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b 1073741824" returned: 0 in 0.595s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:30 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b
Apr 13 18:50:30 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (8c5e38af-c072-47af-bbd3-43c7bfa75073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96e2119-b38e-4ef2-8b01-0ea1da7bdcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96e2119-b38e-4ef2-8b01-0ea1da7bdcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-461442000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c2f3ac-3409-4a5c-85f5-2601b7992233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:30Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad71058-7b80-4e9a-9020-1e0cc305c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad71058-7b80-4e9a-9020-1e0cc305c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a6c17c-3514-4ae1-8014-1e72873dd52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a6c17c-3514-4ae1-8014-1e72873dd52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c2f3ac-3409-4a5c-85f5-2601b7992233', 'volume_name': 'volume-41c2f3ac-3409-4a5c-85f5-2601b7992233', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7a32f9-8c52-4c5a-b2d1-dc68cd761ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7a32f9-8c52-4c5a-b2d1-dc68cd761ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1742aa37-9ee2-42db-a5fe-b0c4cb895036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume 41c2f3ac-3409-4a5c-85f5-2601b7992233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c2f3ac-3409-4a5c-85f5-2601b7992233', 'volume_size': 1}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:30 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (33283d5c-22e1-4d40-8823-d14cc046174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a505ee7-33a6-430e-ae96-e2455cef7c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a505ee7-33a6-430e-ae96-e2455cef7c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558442624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e5ed30-c602-4d84-9443-9d35f01e0bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:30Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8d641d-5cb4-40ae-8a22-542aeeffa738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8d641d-5cb4-40ae-8a22-542aeeffa738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b83900-c075-4e41-a37a-e45f8edbc992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b83900-c075-4e41-a37a-e45f8edbc992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e5ed30-c602-4d84-9443-9d35f01e0bd7', 'volume_name': 'volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301ff39c-b784-40af-b5f9-2a0e5d0d3054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301ff39c-b784-40af-b5f9-2a0e5d0d3054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0b3697-448c-4a26-b43b-a9dc35ef81f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume 51e5ed30-c602-4d84-9443-9d35f01e0bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7', 'volume_size': 1}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f57179ae-5db2-4c8f-8eab-bde0d2253dc9" returned: 0 in 0.528s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-f57179ae-5db2-4c8f-8eab-bde0d2253dc9" released by "delete_volume" :: held 1.054s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Created reservations ['438c3b0e-9f71-4c7d-956d-c53256f939f1', '1da7706e-faa9-4f2a-a6a6-684a225dfca2', '3598d052-9d89-465c-bb30-f44682956fd0', 'ad780c35-c99b-4d0a-a1ed-ef19ceaf65ad'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:30 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:30 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (b18f367d-0882-40ca-bd12-fa742d1481cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca350ae4-8025-4b02-804b-0dfb201a11ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca350ae4-8025-4b02-804b-0dfb201a11ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052480105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1794ac74-70fc-4acc-b8f2-6f4b19001222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:30Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a51127a-994c-4cce-8045-3721b400a903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a51127a-994c-4cce-8045-3721b400a903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9459d15-b13f-464e-ac20-a7cd145937ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9459d15-b13f-464e-ac20-a7cd145937ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1794ac74-70fc-4acc-b8f2-6f4b19001222', 'volume_name': 'volume-1794ac74-70fc-4acc-b8f2-6f4b19001222', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee96b7c0-744d-48f1-9b5b-79bc29d03c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee96b7c0-744d-48f1-9b5b-79bc29d03c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877f97f6-89bf-4a92-8746-b6c50e2be057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume 1794ac74-70fc-4acc-b8f2-6f4b19001222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1794ac74-70fc-4acc-b8f2-6f4b19001222', 'volume_size': 1}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:30 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" returned: 0 in 0.530s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.029s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3cc20a-de1a-4ffb-9d30-f02b090bb54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed71471b-28d4-4e47-9e25-2aec392ffeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Creating offline snapshot deb82b3d-4d81-4842-8326-e80795558bcd of volume fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:50:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Volume volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b (f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b): created successfully
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed71471b-28d4-4e47-9e25-2aec392ffeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Flow 'volume_create_manager' (297b7db5-6b37-4b28-af13-d9fac6f0c704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed917c3-2f21-427c-85b1-c30443b3a3c9]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:30 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-519119c3-95e5-44f2-befa-58a7c137915f tempest-VolumeDependencyTests-421519055 None] Created volume successfully.
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (6a7dcb66-085d-49e2-83dd-d4d421220d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acf9d2e-fbfd-4d58-a6e9-c89eceb01120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acf9d2e-fbfd-4d58-a6e9-c89eceb01120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-96113936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:31Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c788df76-f6b8-48b9-a8a2-0294ae6e3c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c788df76-f6b8-48b9-a8a2-0294ae6e3c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df68b1cd-f3b6-4265-9a7b-3feb8fea192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df68b1cd-f3b6-4265-9a7b-3feb8fea192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a', 'volume_name': 'volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db334cdb-f371-49d5-b60f-f8867c3a23e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db334cdb-f371-49d5-b60f-f8867c3a23e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08153f6-25c9-4de0-b8a9-a9b00466a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a', 'volume_size': 1}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:30 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266
Apr 13 18:50:30 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (0e0e7ced-ca37-4d25-987d-43bc469d3600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd30b81-e4f7-485d-b20e-18ed359b6b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd30b81-e4f7-485d-b20e-18ed359b6b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938694298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8831f52-dd63-4a32-9807-6adb483041b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:31Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1f6ed4-9783-4e9c-9977-83a82f649963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1f6ed4-9783-4e9c-9977-83a82f649963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56c10bc-e6ff-450c-80d7-f32702acf720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56c10bc-e6ff-450c-80d7-f32702acf720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8831f52-dd63-4a32-9807-6adb483041b3', 'volume_name': 'volume-c8831f52-dd63-4a32-9807-6adb483041b3', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f98f52-34c8-4f2c-ae26-9822dc79ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f98f52-34c8-4f2c-ae26-9822dc79ca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba42df36-ad1a-434d-a714-1391cf1eda35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:30 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume c8831f52-dd63-4a32-9807-6adb483041b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8831f52-dd63-4a32-9807-6adb483041b3', 'volume_size': 1}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:30 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.478s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:30 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Deleted volume successfully.
Apr 13 18:50:30 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e0c0344a-0f9d-4f67-bc01-985094ec7948 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-f57179ae-5db2-4c8f-8eab-bde0d2253dc9-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:31 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266" returned: 0 in 0.527s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:31 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd 1G
Apr 13 18:50:31 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Flow 'volume_create_manager' (fee6899d-4c20-49f9-81f6-93b4f54a9404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1558af0-4f14-47be-b880-387271fc9514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1558af0-4f14-47be-b880-387271fc9514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-676671246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984e3fe6-9e10-457b-abf3-d9510e1cb175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2c6654496d4551aaf7c08c8e0dd145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:31Z,use_quota=True,user_id='86dc191e4a8b42be80d459480e7d49b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbede753-3693-4073-9b3b-13c3f6cc490b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbede753-3693-4073-9b3b-13c3f6cc490b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6354e5ee-cccc-4243-84e2-c3ff1cb7dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6354e5ee-cccc-4243-84e2-c3ff1cb7dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '984e3fe6-9e10-457b-abf3-d9510e1cb175', 'volume_name': 'volume-984e3fe6-9e10-457b-abf3-d9510e1cb175', 'volume_size': 1, 'source_volid': 'f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b', 'source_volstatus': 'available'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ab6546-5fca-449a-9807-0358c3ed7f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ab6546-5fca-449a-9807-0358c3ed7f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026a8291-9bb2-4821-bf31-3f254fd2fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:31 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Volume 984e3fe6-9e10-457b-abf3-d9510e1cb175: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-984e3fe6-9e10-457b-abf3-d9510e1cb175', 'volume_size': 1, 'source_volid': 'f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b', 'source_volstatus': 'available'}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-a8aa45d0-fde0-41f4-a024-aebd1a62f64f-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-a8aa45d0-fde0-41f4-a024-aebd1a62f64f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-quobyte-a8aa45d0-fde0-41f4-a024-aebd1a62f64f" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-a8aa45d0-fde0-41f4-a024-aebd1a62f64f" acquired by "delete_volume" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79f5f58-abe2-4a17-befa-9d34422d0cef]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:31 devstack sudo[90674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f
Apr 13 18:50:31 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:31 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd 1G" returned: 0 in 0.531s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd48d040-894a-44ac-b579-58192c6d1266 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:31 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd48d040-894a-44ac-b579-58192c6d1266 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd
Apr 13 18:50:31 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:31 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f" returned: 0 in 0.482s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:31 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:31 devstack sudo[90684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f
Apr 13 18:50:31 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:32 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd48d040-894a-44ac-b579-58192c6d1266 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd" returned: 0 in 0.420s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:32 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd is being set with open permissions: ugo+rw
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:32 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd
Apr 13 18:50:32 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:32 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-a8aa45d0-fde0-41f4-a024-aebd1a62f64f" returned: 0 in 0.428s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-a8aa45d0-fde0-41f4-a024-aebd1a62f64f" released by "delete_volume" :: held 0.930s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Created reservations ['8870f80b-1064-4413-9853-32824170b557', 'ac60f04c-b101-4c9d-8989-0e56e633a218', '1d978002-84aa-4482-9ab7-4f82cfa77b93', 'c5dc5db7-3b1f-49b4-ac75-fe3c0b1f54a1'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:32 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:32 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-ea64994b-ea20-4379-b462-c45f47de5cf3-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-ea64994b-ea20-4379-b462-c45f47de5cf3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-quobyte-ea64994b-ea20-4379-b462-c45f47de5cf3" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-ea64994b-ea20-4379-b462-c45f47de5cf3" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:32 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3a0061-f879-4606-9716-542b053a477f]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd" returned: 0 in 0.451s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:32 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.info
Apr 13 18:50:32 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:32 devstack sudo[90695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3
Apr 13 18:50:32 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:32 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.407s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:32 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Deleted volume successfully.
Apr 13 18:50:32 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-89459d01-e602-419f-9f4f-705990bc7251 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-a8aa45d0-fde0-41f4-a024-aebd1a62f64f-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:33 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.info" returned: 0 in 0.413s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:33 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.info is being set with open permissions: ugo+rw
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:33 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.info
Apr 13 18:50:33 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:33 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3" returned: 0 in 0.486s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:33 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3
Apr 13 18:50:33 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:33 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.info" returned: 0 in 0.426s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:33 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.298s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-461442000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c2f3ac-3409-4a5c-85f5-2601b7992233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:30Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Creating volume 41c2f3ac-3409-4a5c-85f5-2601b7992233 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:33 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-ea64994b-ea20-4379-b462-c45f47de5cf3" returned: 0 in 0.437s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:33 devstack sudo[90710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233 1073741824
Apr 13 18:50:33 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-ea64994b-ea20-4379-b462-c45f47de5cf3" released by "delete_volume" :: held 0.951s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:33 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-285c5c86-b031-4f9d-b818-6239323e0ab6 tempest-SnapshotDependencyTests-627672191 None] Create snapshot completed successfully
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Created reservations ['97c217d1-96a8-4192-884b-65a8d67871c2', '0db9c9fa-658e-4b70-8c11-28d8d5ea47a1', 'c54a4e15-bd46-4d3b-bd19-dad90b68cb37', 'ef2453d9-df53-406e-96ad-21dfcb121fd0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:33 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:33 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-bb9d0b1e-d389-4857-ba35-67d92435b259-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-bb9d0b1e-d389-4857-ba35-67d92435b259-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-quobyte-bb9d0b1e-d389-4857-ba35-67d92435b259" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-bb9d0b1e-d389-4857-ba35-67d92435b259" acquired by "delete_volume" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[df091e2d-114e-4b76-9331-b35cc9b6ae18]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:33 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:33 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259
Apr 13 18:50:33 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:34 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233 1073741824" returned: 0 in 0.514s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:34 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233
Apr 13 18:50:34 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:34 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.506s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:34 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Deleted volume successfully.
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a7135df4-4548-46a8-985c-41c970c0bf8b tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-ea64994b-ea20-4379-b462-c45f47de5cf3-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Flow 'volume_create_manager' (2ede78fd-a198-4aa8-be9e-4d6c90c3a9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8868e0c4-adf9-4b0d-aa3a-8cbb6a90e310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8868e0c4-adf9-4b0d-aa3a-8cbb6a90e310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f35c9b-d5e7-4c32-a767-ad920167e9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d29f0a7e7354c888133055a8c5ddec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=deb82b3d-4d81-4842-8326-e80795558bcd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:34Z,use_quota=True,user_id='4a5de35e0e80420e9e2e97c7d067e6e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557a28b0-565a-4522-af77-e2917ae0923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557a28b0-565a-4522-af77-e2917ae0923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23938bcc-92fd-4f62-8bfa-767d1a02c2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23938bcc-92fd-4f62-8bfa-767d1a02c2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5f35c9b-d5e7-4c32-a767-ad920167e9da', 'volume_name': 'volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da', 'volume_size': 1, 'snapshot_id': 'deb82b3d-4d81-4842-8326-e80795558bcd'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490584a3-44e8-4183-ae73-c9971d89059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490584a3-44e8-4183-ae73-c9971d89059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96b17fc-c42c-4e55-bf76-05416e84b79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:34 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Volume c5f35c9b-d5e7-4c32-a767-ad920167e9da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da', 'volume_size': 1, 'snapshot_id': 'deb82b3d-4d81-4842-8326-e80795558bcd'}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:34 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259" returned: 0 in 0.554s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:34 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259
Apr 13 18:50:34 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:34 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233" returned: 0 in 0.465s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.198s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558442624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e5ed30-c602-4d84-9443-9d35f01e0bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:30Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Creating volume 51e5ed30-c602-4d84-9443-9d35f01e0bd7 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:34 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1742aa37-9ee2-42db-a5fe-b0c4cb895036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c2f3ac-3409-4a5c-85f5-2601b7992233', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:34 devstack sudo[90729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7 1073741824
Apr 13 18:50:34 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e2e485-de17-4de8-8fa2-f3629d3832ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:34 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume volume-41c2f3ac-3409-4a5c-85f5-2601b7992233 (41c2f3ac-3409-4a5c-85f5-2601b7992233): created successfully
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e2e485-de17-4de8-8fa2-f3629d3832ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (8c5e38af-c072-47af-bbd3-43c7bfa75073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:34 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-c8437d14-ba93-4929-aca1-f4fb217dcdda tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created volume successfully.
Apr 13 18:50:34 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-bb9d0b1e-d389-4857-ba35-67d92435b259" returned: 0 in 0.453s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-bb9d0b1e-d389-4857-ba35-67d92435b259" released by "delete_volume" :: held 1.027s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Created reservations ['6dbe2f90-5821-401b-b719-89dfb7975980', '7abfa8a6-dc01-4451-b06e-1fbf8c316714', '5d1cffe5-4598-46c0-9e60-ec831c55c618', '9bebeb40-992e-4e77-8d5c-6ee796cedc3e'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:34 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:34 devstack sudo[90732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:34 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:35 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7 1073741824" returned: 0 in 0.479s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:35 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7
Apr 13 18:50:35 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:35 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.426s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:35 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Deleted volume successfully.
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-79691f03-5ebe-4272-8c7c-9a96dcf5d5c8 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-bb9d0b1e-d389-4857-ba35-67d92435b259-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:35 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7" returned: 0 in 0.435s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.935s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052480105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1794ac74-70fc-4acc-b8f2-6f4b19001222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:30Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Creating volume 1794ac74-70fc-4acc-b8f2-6f4b19001222 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:35 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0b3697-448c-4a26-b43b-a9dc35ef81f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fead13-f658-40d2-bed1-6b6b0d81bacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:35 devstack sudo[90741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222 1073741824
Apr 13 18:50:35 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:35 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7 (51e5ed30-c602-4d84-9443-9d35f01e0bd7): created successfully
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53fead13-f658-40d2-bed1-6b6b0d81bacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (33283d5c-22e1-4d40-8823-d14cc046174d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:35 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-1ea37c18-2533-4d01-b6a5-02454bd0f56a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created volume successfully.
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-468290c7-1696-4966-a45e-3868559e3f3e-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-468290c7-1696-4966-a45e-3868559e3f3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-quobyte-c6845e32-d4b5-49e6-aead-d21c67217edd" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-c6845e32-d4b5-49e6-aead-d21c67217edd" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-quobyte-468290c7-1696-4966-a45e-3868559e3f3e" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-468290c7-1696-4966-a45e-3868559e3f3e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Deleting offline snapshot 468290c7-1696-4966-a45e-3868559e3f3e of volume c6845e32-d4b5-49e6-aead-d21c67217edd {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] snapshot_file for this snap is: volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc828d-5034-49f4-95e6-23d5fd3edb7d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:35 devstack sudo[90746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e
Apr 13 18:50:35 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:35 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222 1073741824" returned: 0 in 0.493s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:35 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:36 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222
Apr 13 18:50:36 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:36 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e" returned: 0 in 0.484s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6845e32-d4b5-49e6-aead-d21c67217edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c429372-5a43-4b6e-8ccf-9484cf5a81a0]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:36 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222" returned: 0 in 0.410s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.662s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-96113936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:31Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Creating volume e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:36 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877f97f6-89bf-4a92-8746-b6c50e2be057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1794ac74-70fc-4acc-b8f2-6f4b19001222', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d0964b-ebc1-4282-af14-468ca7f437f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:36 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a 1073741824
Apr 13 18:50:36 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:36 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume volume-1794ac74-70fc-4acc-b8f2-6f4b19001222 (1794ac74-70fc-4acc-b8f2-6f4b19001222): created successfully
Apr 13 18:50:36 devstack sudo[90754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd
Apr 13 18:50:36 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d0964b-ebc1-4282-af14-468ca7f437f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (b18f367d-0882-40ca-bd12-fa742d1481cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:36 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2075720e-b86d-4b96-8980-8a518a73de72 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created volume successfully.
Apr 13 18:50:36 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd" returned: 0 in 0.467s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:36 devstack sudo[90764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e
Apr 13 18:50:36 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:36 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a 1073741824" returned: 0 in 0.475s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:36 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:36 devstack sudo[90766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a
Apr 13 18:50:36 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:37 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a" returned: 0 in 0.410s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.438s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938694298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8831f52-dd63-4a32-9807-6adb483041b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd1dc4865a94c639af9931148c25821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:31Z,use_quota=True,user_id='5e9f8f2053af4e81ae7268ca25d52dad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Creating volume c8831f52-dd63-4a32-9807-6adb483041b3 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:37 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:37 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:37 devstack sudo[90772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3 1073741824
Apr 13 18:50:37 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08153f6-25c9-4de0-b8a9-a9b00466a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fb0fd7-25d0-49d8-8da1-a7dd0ddbe09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:37 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e
Apr 13 18:50:37 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:37 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a (e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a): created successfully
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fb0fd7-25d0-49d8-8da1-a7dd0ddbe09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (6a7dcb66-085d-49e2-83dd-d4d421220d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:37 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-cba37875-f8e4-4c0e-902c-d7709d1afe26 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created volume successfully.
Apr 13 18:50:37 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd.468290c7-1696-4966-a45e-3868559e3f3e" returned: 0 in 0.416s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-468290c7-1696-4966-a45e-3868559e3f3e" released by "_delete_snapshot" :: held 1.921s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-c6845e32-d4b5-49e6-aead-d21c67217edd" released by "delete_snapshot" :: held 1.934s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Created reservations ['f0353080-d082-483f-b189-886129327671', '40c12def-b77e-42df-953f-a7ded0dc0f4b', 'f27b0b89-9bd8-4271-b083-14ff038cc7c8', 'c1d1dd72-dbfe-4214-b5d6-033e1fa7a905'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:37 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3 1073741824" returned: 0 in 0.495s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:37 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Delete snapshot completed successfully.
Apr 13 18:50:37 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-66859786-25a8-4c32-acba-99f7eda6631a tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-468290c7-1696-4966-a45e-3868559e3f3e-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:37 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-c6845e32-d4b5-49e6-aead-d21c67217edd-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:37 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-c6845e32-d4b5-49e6-aead-d21c67217edd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "cinder-quobyte-c6845e32-d4b5-49e6-aead-d21c67217edd" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-c6845e32-d4b5-49e6-aead-d21c67217edd" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[73699a75-c590-4c21-8584-c353f989abc8]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:38 devstack sudo[90782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd
Apr 13 18:50:38 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:38 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3" returned: 0 in 0.449s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.890s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:38 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Cloning volume f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b to volume 984e3fe6-9e10-457b-abf3-d9510e1cb175
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba42df36-ad1a-434d-a714-1391cf1eda35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8831f52-dd63-4a32-9807-6adb483041b3', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1970fede-e5f7-4c5a-aed2-a9db5a28f4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:38 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Volume volume-c8831f52-dd63-4a32-9807-6adb483041b3 (c8831f52-dd63-4a32-9807-6adb483041b3): created successfully
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1970fede-e5f7-4c5a-aed2-a9db5a28f4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Flow 'volume_create_manager' (0e0e7ced-ca37-4d25-987d-43bc469d3600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Creating offline snapshot 75f98dcb-7095-4222-8208-d58cf41a8c13 of volume f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:50:38 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f3c93de6-caef-4996-ad1d-7b3c6db61985 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created volume successfully.
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c6b744-d0cf-4540-89be-21459e8bb768]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:38 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b
Apr 13 18:50:38 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:38 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd" returned: 0 in 0.462s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:38 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd
Apr 13 18:50:38 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:38 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" returned: 0 in 0.478s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:38 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 1G
Apr 13 18:50:38 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:38 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c6845e32-d4b5-49e6-aead-d21c67217edd" returned: 0 in 0.404s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-quobyte-c6845e32-d4b5-49e6-aead-d21c67217edd" released by "delete_volume" :: held 0.900s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Created reservations ['76ba658b-1dfa-4c72-a3a3-47559f843fe0', '29c2c949-e592-476d-9a23-530542e10a8d', '5481229a-70f8-4c0c-9792-0885a3f14522', '15140bfe-9089-4c7f-ba7c-109307e58338'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:38 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:38 devstack sudo[90798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:38 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:39 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 1G" returned: 0 in 0.562s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:39 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13
Apr 13 18:50:39 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:39 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.479s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:39 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Deleted volume successfully.
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-67c2575c-2ae6-4b7a-921f-e1685a9e8650 tempest-CreateVolumesFromSnapshotTest-617215783 None] Lock "cinder-c6845e32-d4b5-49e6-aead-d21c67217edd-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-c8831f52-dd63-4a32-9807-6adb483041b3-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-c8831f52-dd63-4a32-9807-6adb483041b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-quobyte-c8831f52-dd63-4a32-9807-6adb483041b3" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-c8831f52-dd63-4a32-9807-6adb483041b3" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbadd8a-948f-4bb3-b23a-9cea63fea078]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:39 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3
Apr 13 18:50:39 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:39 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13" returned: 0 in 0.527s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:39 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 is being set with open permissions: ugo+rw
Apr 13 18:50:39 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:39 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13
Apr 13 18:50:39 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:40 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3" returned: 0 in 0.553s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:40 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3
Apr 13 18:50:40 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:40 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13" returned: 0 in 0.475s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:40 devstack sudo[90819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.info
Apr 13 18:50:40 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:40 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c8831f52-dd63-4a32-9807-6adb483041b3" returned: 0 in 0.498s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-c8831f52-dd63-4a32-9807-6adb483041b3" released by "delete_volume" :: held 1.089s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created reservations ['7d1c6d92-6bca-4f5e-9fe7-7de5e4c1b48d', 'f93e8b15-1c21-4c8a-9824-7224bfc18e7f', '8ef6289f-d28d-4251-9ef7-9e85a457238c', '7f16faba-c730-41f3-bd18-155f07fa34f0'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:40 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:40 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Flow 'volume_create_manager' (b980cf75-e237-445e-8d7d-9d2a5265bc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed40ea0-9875-4e62-bd7a-0133fb5ec4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed40ea0-9875-4e62-bd7a-0133fb5ec4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5978cb22-7652-480d-8ed0-a0c1d14d63f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9df2a5b7d2a4b7186257516d2b506f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:41Z,use_quota=True,user_id='b29806f806bb453d9aa978f77be4da05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f26643-5294-424b-9efb-015f43c5288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f26643-5294-424b-9efb-015f43c5288d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aded584-d9b9-4c95-8e0a-37e9a05aa97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aded584-d9b9-4c95-8e0a-37e9a05aa97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5978cb22-7652-480d-8ed0-a0c1d14d63f4', 'volume_name': 'volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72364f1f-051a-4d45-9b67-257baea833e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72364f1f-051a-4d45-9b67-257baea833e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642f3672-32db-4e82-8378-405c946f8dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:40 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Volume 5978cb22-7652-480d-8ed0-a0c1d14d63f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4', 'volume_size': 1}
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:40 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.info" returned: 0 in 0.487s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:40 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.info is being set with open permissions: ugo+rw
Apr 13 18:50:40 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:40 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.info
Apr 13 18:50:40 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:41 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.424s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:41 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Deleted volume successfully.
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-a00b23b0-05f8-437c-b115-62f8109dbb5c tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-c8831f52-dd63-4a32-9807-6adb483041b3-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:41 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.info" returned: 0 in 0.432s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-984e3fe6-9e10-457b-abf3-d9510e1cb175" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-984e3fe6-9e10-457b-abf3-d9510e1cb175" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] snapshot: 75f98dcb-7095-4222-8208-d58cf41a8c13, volume: 984e3fe6-9e10-457b-abf3-d9510e1cb175,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c23f879-9e6d-4fca-9ac1-4755c1765336]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:41 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13
Apr 13 18:50:41 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-quobyte-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a" acquired by "delete_volume" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38d0ee7-be34-4799-9c97-b6e8934b6e89]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:41 devstack sudo[90831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a
Apr 13 18:50:41 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:41 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13" returned: 0 in 0.488s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f70926e-a27a-4656-9b4e-e3158ce8d0d5]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:41 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:41 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b
Apr 13 18:50:41 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:42 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a" returned: 0 in 0.471s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:42 devstack sudo[90841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a
Apr 13 18:50:42 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:42 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" returned: 0 in 0.468s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175 not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:42 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175
Apr 13 18:50:42 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:42 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a" returned: 0 in 0.423s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a" released by "delete_volume" :: held 0.917s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created reservations ['a7616290-8da2-48ac-a84b-18ffde6bc0bb', '244509b1-f4a9-4d79-94b5-f07046905669', '370c2733-08de-4ef0-874f-5e149faf2301', '0db46eaf-efa7-439c-bec5-cd6c11f58b0f'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:42 devstack sudo[90852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:42 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-1794ac74-70fc-4acc-b8f2-6f4b19001222-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-1794ac74-70fc-4acc-b8f2-6f4b19001222-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-quobyte-1794ac74-70fc-4acc-b8f2-6f4b19001222" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-1794ac74-70fc-4acc-b8f2-6f4b19001222" acquired by "delete_volume" :: waited 0.015s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257252c-b2a7-4871-a8ca-27cc6b976cd3]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:42 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:43 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222
Apr 13 18:50:43 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:44 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 1.423s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:44 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Deleted volume successfully.
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-853a015a-7127-48df-af74-6575bfa757cd tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-e79e3182-0fed-4a70-a2f1-b8b1c7a50e8a-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:44 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175" returned: 0 in 2.078s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[be429bb8-f046-4829-b6e7-0d79060e0662]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:44 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222" returned: 0 in 1.528s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:44 devstack sudo[90870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222
Apr 13 18:50:44 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:44 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b
Apr 13 18:50:44 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:44 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-1794ac74-70fc-4acc-b8f2-6f4b19001222" returned: 0 in 0.404s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-1794ac74-70fc-4acc-b8f2-6f4b19001222" released by "delete_volume" :: held 1.971s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created reservations ['76ce7af7-09ec-44df-a472-6c4ad81fd2c5', '12f93445-4806-4506-8bd7-d3b22c8e0eaa', '39d8cced-6897-4a39-b29b-39695181e1e4', 'f20c1901-e7f7-4156-9e6c-d7b31c26bf65'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:44 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:44 devstack sudo[90876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:44 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:45 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" returned: 0 in 0.579s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175 {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:50:45 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Converted 1024.00 MB image at 492.57 MB/s
Apr 13 18:50:45 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175 is being set with open permissions: ugo+rw
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:45 devstack sudo[90879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175
Apr 13 18:50:45 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:45 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.416s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:45 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Deleted volume successfully.
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-f5187928-1b71-4959-8575-9c115d92338b tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-1794ac74-70fc-4acc-b8f2-6f4b19001222-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-51e5ed30-c602-4d84-9443-9d35f01e0bd7-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-51e5ed30-c602-4d84-9443-9d35f01e0bd7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:45 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175" returned: 0 in 0.439s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-984e3fe6-9e10-457b-abf3-d9510e1cb175" released by "_copy_volume_from_snapshot" :: held 4.096s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-quobyte-51e5ed30-c602-4d84-9443-9d35f01e0bd7" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-75f98dcb-7095-4222-8208-d58cf41a8c13" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-51e5ed30-c602-4d84-9443-9d35f01e0bd7" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-75f98dcb-7095-4222-8208-d58cf41a8c13" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Deleting offline snapshot 75f98dcb-7095-4222-8208-d58cf41a8c13 of volume f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] snapshot_file for this snap is: volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[555235f8-d6ea-4cc4-a6ae-d8df22e95d17]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78115dc-657d-4611-9680-618d4c25d520]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:45 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7
Apr 13 18:50:45 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:45 devstack sudo[90884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13
Apr 13 18:50:45 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:45 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7" returned: 0 in 0.453s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:45 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7
Apr 13 18:50:45 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:45 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13" returned: 0 in 0.467s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:45 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed21a7a7-ff70-42f7-9dd0-c16900ab377d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:46 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b
Apr 13 18:50:46 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:46 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-51e5ed30-c602-4d84-9443-9d35f01e0bd7" returned: 0 in 0.408s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-51e5ed30-c602-4d84-9443-9d35f01e0bd7" released by "delete_volume" :: held 0.897s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created reservations ['37f1c963-448c-4d14-ba4e-5cf14a054464', '63d0104f-0b32-478b-91b8-7967edecb65d', 'b30aafc9-9d57-4e53-95ad-d5e1802c7c0e', '50d3e5a4-32c6-4e27-9023-f190a00dbbfd'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:46 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:46 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:46 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" returned: 0 in 0.503s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:46 devstack sudo[90903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13
Apr 13 18:50:46 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-41c2f3ac-3409-4a5c-85f5-2601b7992233-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-41c2f3ac-3409-4a5c-85f5-2601b7992233-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-quobyte-41c2f3ac-3409-4a5c-85f5-2601b7992233" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-41c2f3ac-3409-4a5c-85f5-2601b7992233" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b4b8c-f676-40a0-b39a-7dbb38c3a761]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:46 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233
Apr 13 18:50:46 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:46 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.431s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:46 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Deleted volume successfully.
Apr 13 18:50:46 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-35887656-7af7-4e32-bf85-6a5a9ba03c1a tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-51e5ed30-c602-4d84-9443-9d35f01e0bd7-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:46 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13" returned: 0 in 0.485s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:47 devstack sudo[90911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13
Apr 13 18:50:47 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:47 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233" returned: 0 in 0.504s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:47 devstack sudo[90916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233
Apr 13 18:50:47 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:47 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b.75f98dcb-7095-4222-8208-d58cf41a8c13" returned: 0 in 0.395s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-75f98dcb-7095-4222-8208-d58cf41a8c13" released by "_delete_snapshot" :: held 1.906s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.110s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.221s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "cinder-quobyte-deb82b3d-4d81-4842-8326-e80795558bcd-c5f35c9b-d5e7-4c32-a767-ad920167e9da" by "_create_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026a8291-9bb2-4821-bf31-3f254fd2fb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984e3fe6-9e10-457b-abf3-d9510e1cb175', 'volume_size': 1, 'source_volid': 'f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b', 'source_volstatus': 'available'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07177e1b-663c-4675-8ed7-6d8ac559746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-deb82b3d-4d81-4842-8326-e80795558bcd-c5f35c9b-d5e7-4c32-a767-ad920167e9da" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Creating volume c5f35c9b-d5e7-4c32-a767-ad920167e9da from snapshot deb82b3d-4d81-4842-8326-e80795558bcd {{(pid=82517) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "cinder-quobyte-c5f35c9b-d5e7-4c32-a767-ad920167e9da" by "_copy_volume_from_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:47 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Volume volume-984e3fe6-9e10-457b-abf3-d9510e1cb175 (984e3fe6-9e10-457b-abf3-d9510e1cb175): created successfully
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07177e1b-663c-4675-8ed7-6d8ac559746e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Flow 'volume_create_manager' (fee6899d-4c20-49f9-81f6-93b4f54a9404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-c5f35c9b-d5e7-4c32-a767-ad920167e9da" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] snapshot: deb82b3d-4d81-4842-8326-e80795558bcd, volume: c5f35c9b-d5e7-4c32-a767-ad920167e9da,  {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:47 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-9f3a1a97-63c3-47d6-ba1f-8ac0dfcab9e7 tempest-VolumeDependencyTests-421519055 None] Created volume successfully.
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d56793-2e64-458d-b9c8-c4f3034389cb]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:47 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-41c2f3ac-3409-4a5c-85f5-2601b7992233" returned: 0 in 0.416s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-41c2f3ac-3409-4a5c-85f5-2601b7992233" released by "delete_volume" :: held 0.950s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:47 devstack sudo[90920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd
Apr 13 18:50:47 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created reservations ['10338b0b-0fa9-4da1-b9a3-9424282570ff', 'cc027570-ed9d-4bf6-9fbf-025bcca1b74d', '06cb887d-5bc5-4774-a898-26e78411f728', '23fe2e52-9a03-49e8-ae3b-196a3a9d0b34'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:47 devstack sudo[90922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:47 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-d50d41a8-c85b-4d50-b830-81ca5a52188e-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-d50d41a8-c85b-4d50-b830-81ca5a52188e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "cinder-quobyte-d50d41a8-c85b-4d50-b830-81ca5a52188e" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-d50d41a8-c85b-4d50-b830-81ca5a52188e" acquired by "delete_volume" :: waited 0.006s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91bf8be-6360-4e42-b249-9a115152494d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:47 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:47 devstack sudo[90924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e
Apr 13 18:50:47 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:47 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd" returned: 0 in 0.489s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd48d040-894a-44ac-b579-58192c6d1266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Creating direct copy from snapshot {{(pid=82517) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[af22e5f2-f53e-4dce-8993-719daedea6e7]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:48 devstack sudo[90932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266
Apr 13 18:50:48 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:48 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.432s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:48 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Deleted volume successfully.
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-1c04f8b0-81cb-4dfa-86cd-f1a61318f492 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-41c2f3ac-3409-4a5c-85f5-2601b7992233-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:48 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e" returned: 0 in 0.532s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:48 devstack sudo[90937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e
Apr 13 18:50:48 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Lock "cinder-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" acquired by "delete_volume" :: waited 0.012s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc641dda-c625-447d-8b20-92ac98dffd10]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:48 devstack sudo[90939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b
Apr 13 18:50:48 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:48 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266" returned: 0 in 0.510s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.utils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Path /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da not found in is_blk_device check {{(pid=82517) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:48 devstack sudo[90944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da
Apr 13 18:50:48 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:48 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-d50d41a8-c85b-4d50-b830-81ca5a52188e" returned: 0 in 0.411s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-quobyte-d50d41a8-c85b-4d50-b830-81ca5a52188e" released by "delete_volume" :: held 0.972s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Created reservations ['3d74002f-3b97-4d57-b821-86fd90f78e1f', '8ab85e6b-c88e-48be-9190-13138042c7e4', 'd017a02e-cb6e-4a05-8f47-456e6c9c4046', 'cd480b2d-94ff-4852-b754-74b9298969d2'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:48 devstack sudo[90950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:48 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:48 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" returned: 0 in 0.482s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:48 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:48 devstack sudo[90952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b
Apr 13 18:50:48 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:49 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.699s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:49 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:49 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Deleted volume successfully.
Apr 13 18:50:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-7734b562-dcfe-4b5b-9b42-0c51b2d5be22 tempest-CreateVolumesFromSourceVolumeTest-626253038 None] Lock "cinder-d50d41a8-c85b-4d50-b830-81ca5a52188e-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:49 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:49 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" returned: 0 in 1.028s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:49 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b" released by "delete_volume" :: held 1.547s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Created reservations ['b77564bc-1466-465d-baa4-9105dd0941eb', '8ed96972-e019-4681-be74-4e2552811f1d', '30141d85-e935-414f-8790-89ccb6ee43ea', '3ebad2db-9918-4fb5-98aa-cbae471e4dbb'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:50 devstack sudo[90971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:50 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-984e3fe6-9e10-457b-abf3-d9510e1cb175-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Lock "cinder-984e3fe6-9e10-457b-abf3-d9510e1cb175-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-984e3fe6-9e10-457b-abf3-d9510e1cb175" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-984e3fe6-9e10-457b-abf3-d9510e1cb175" acquired by "delete_volume" :: waited 0.020s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[f840f413-61bb-4307-98a8-596236b4e1e9]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:50 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175
Apr 13 18:50:50 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:50 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da" returned: 0 in 2.390s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab5597-0f36-41a7-9d3f-88fc0a1861b8]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:50 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:51 devstack sudo[90975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266
Apr 13 18:50:51 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:51 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.827s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:51 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Deleted volume successfully.
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-cd11a5d5-1d51-40bf-8bcc-f253e0d7a14b tempest-VolumeDependencyTests-421519055 None] Lock "cinder-f599b4ed-d4e9-4a72-ba3e-a3d340dccc6b-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:51 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175" returned: 0 in 0.607s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:51 devstack sudo[90983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175
Apr 13 18:50:51 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:51 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266" returned: 0 in 0.652s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG cinder.image.image_utils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Image conversion details: src /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da {{(pid=82517) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 18:50:51 devstack cinder-volume[82517]: INFO cinder.image.image_utils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Converted 1024.00 MB image at 427.69 MB/s
Apr 13 18:50:51 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da is being set with open permissions: ugo+rw
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:51 devstack sudo[90986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da
Apr 13 18:50:51 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:51 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-984e3fe6-9e10-457b-abf3-d9510e1cb175" returned: 0 in 0.414s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-984e3fe6-9e10-457b-abf3-d9510e1cb175" released by "delete_volume" :: held 1.058s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Created reservations ['0b3e459f-751f-4cd1-abfd-ddd3c53e396a', '7ab3fd32-3e7b-4630-a81c-b4d1d329467c', '8f108360-4632-474f-a34d-5e49ec2d9ef6', 'f5660735-8799-409e-93bf-7d5c5d9dd020'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:51 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:51 devstack sudo[90989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:51 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:52 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da" returned: 0 in 0.438s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-c5f35c9b-d5e7-4c32-a767-ad920167e9da" released by "_copy_volume_from_snapshot" :: held 4.540s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-deb82b3d-4d81-4842-8326-e80795558bcd-c5f35c9b-d5e7-4c32-a767-ad920167e9da" released by "_create_volume_from_snapshot" :: held 4.568s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.588s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.129s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5978cb22-7652-480d-8ed0-a0c1d14d63f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9df2a5b7d2a4b7186257516d2b506f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:41Z,use_quota=True,user_id='b29806f806bb453d9aa978f77be4da05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Creating volume 5978cb22-7652-480d-8ed0-a0c1d14d63f4 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:52 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:52 devstack sudo[90992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4 1073741824
Apr 13 18:50:52 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96b17fc-c42c-4e55-bf76-05416e84b79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da', 'volume_size': 1, 'snapshot_id': 'deb82b3d-4d81-4842-8326-e80795558bcd'}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b5f989-d88f-4e64-bf64-3ec3680f959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:52 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Volume volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da (c5f35c9b-d5e7-4c32-a767-ad920167e9da): created successfully
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b5f989-d88f-4e64-bf64-3ec3680f959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Flow 'volume_create_manager' (2ede78fd-a198-4aa8-be9e-4d6c90c3a9ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:52 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b58fec3c-59ff-49dd-9dd8-c9b0b4f88f84 tempest-SnapshotDependencyTests-627672191 None] Created volume successfully.
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "cinder-deb82b3d-4d81-4842-8326-e80795558bcd-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-deb82b3d-4d81-4842-8326-e80795558bcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "cinder-quobyte-fd48d040-894a-44ac-b579-58192c6d1266" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-fd48d040-894a-44ac-b579-58192c6d1266" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "cinder-quobyte-deb82b3d-4d81-4842-8326-e80795558bcd" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:52 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.468s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-deb82b3d-4d81-4842-8326-e80795558bcd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Deleting offline snapshot deb82b3d-4d81-4842-8326-e80795558bcd of volume fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] snapshot_file for this snap is: volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:50:52 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Deleted volume successfully.
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a69efb0-9fb0-40f8-96da-cffdab0d9cd5]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3b31b6ce-0290-4e0c-b3c0-0d0dd6488cba tempest-VolumeDependencyTests-421519055 None] Lock "cinder-984e3fe6-9e10-457b-abf3-d9510e1cb175-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:52 devstack sudo[90995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd
Apr 13 18:50:52 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:52 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4 1073741824" returned: 0 in 0.515s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:52 devstack sudo[91000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4
Apr 13 18:50:52 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-89d2f835-1127-4cba-a870-766cbce7409c-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:52 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Lock "cinder-89d2f835-1127-4cba-a870-766cbce7409c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd" returned: 0 in 0.526s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd48d040-894a-44ac-b579-58192c6d1266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[09350bc1-d58a-42c0-abc7-c3447ba3d035]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Acquiring lock "cinder-quobyte-89d2f835-1127-4cba-a870-766cbce7409c" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-89d2f835-1127-4cba-a870-766cbce7409c" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0e6579-b8f5-4f02-9a4d-1b45b22f8bab]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:52 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:52 devstack sudo[91005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266
Apr 13 18:50:52 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:53 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4" returned: 0 in 0.440s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:53 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c
Apr 13 18:50:53 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642f3672-32db-4e82-8378-405c946f8dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae13030-0813-4edc-884f-e07d1f174916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:53 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Volume volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4 (5978cb22-7652-480d-8ed0-a0c1d14d63f4): created successfully
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae13030-0813-4edc-884f-e07d1f174916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Flow 'volume_create_manager' (b980cf75-e237-445e-8d7d-9d2a5265bc27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:53 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-2f630adc-58a0-496a-9413-37670df9851b tempest-CinderUnicodeTest-2123915590 None] Created volume successfully.
Apr 13 18:50:53 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266" returned: 0 in 0.488s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:53 devstack sudo[91016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd
Apr 13 18:50:53 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:53 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c" returned: 0 in 0.479s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:53 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c
Apr 13 18:50:53 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:53 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-89d2f835-1127-4cba-a870-766cbce7409c" returned: 0 in 0.405s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Lock "cinder-quobyte-89d2f835-1127-4cba-a870-766cbce7409c" released by "delete_volume" :: held 0.910s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:53 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd" returned: 0 in 0.481s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:53 devstack sudo[91025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd
Apr 13 18:50:53 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Created reservations ['1f3fe6cf-4b12-40cc-ac0d-5c523829aa5e', 'e5d0b1dc-43c9-4ffb-8426-ac0936ffa6b7', '78ccb2e1-6283-44ef-b6aa-dd3be71bea24', 'b3c92ba2-5a44-4f63-aeeb-e7294c5d89aa'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:53 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:53 devstack sudo[91027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:53 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82517) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Flow 'volume_create_manager' (43b56c2f-ef5d-45cc-94f0-8107cf39a7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b434ef96-c374-4e61-8112-44922973b066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b434ef96-c374-4e61-8112-44922973b066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-290432756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cf8513-7d07-4b08-a544-4e6da19d6d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9df2a5b7d2a4b7186257516d2b506f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:54Z,use_quota=True,user_id='b29806f806bb453d9aa978f77be4da05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c91337-99d0-4002-b725-502f0a007b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c91337-99d0-4002-b725-502f0a007b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717e2e41-b330-4050-ad6b-c10e1bf764d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717e2e41-b330-4050-ad6b-c10e1bf764d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77cf8513-7d07-4b08-a544-4e6da19d6d40', 'volume_name': 'volume-77cf8513-7d07-4b08-a544-4e6da19d6d40', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a138d0de-135c-41f4-8ae5-e0b94cf48c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a138d0de-135c-41f4-8ae5-e0b94cf48c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e293af22-c8a4-4fcf-ac88-27bf34f41b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:54 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Volume 77cf8513-7d07-4b08-a544-4e6da19d6d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77cf8513-7d07-4b08-a544-4e6da19d6d40', 'volume_size': 1}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f9e0cd563b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T16:50:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-290432756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cf8513-7d07-4b08-a544-4e6da19d6d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9df2a5b7d2a4b7186257516d2b506f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T16:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T16:50:54Z,use_quota=True,user_id='b29806f806bb453d9aa978f77be4da05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c55101-e302-46ca-8653-2a98654e9642),volume_type_id=92c55101-e302-46ca-8653-2a98654e9642)}" {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Creating volume 77cf8513-7d07-4b08-a544-4e6da19d6d40 {{(pid=82517) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Selected osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f as target Quobyte volume. {{(pid=82517) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 18:50:54 devstack cinder-volume[82517]: INFO cinder.volume.drivers.remotefs [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] casted to osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 1073741824 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:54 devstack sudo[91029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 1073741824
Apr 13 18:50:54 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:54 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266.deb82b3d-4d81-4842-8326-e80795558bcd" returned: 0 in 0.567s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-deb82b3d-4d81-4842-8326-e80795558bcd" released by "_delete_snapshot" :: held 2.123s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-fd48d040-894a-44ac-b579-58192c6d1266" released by "delete_snapshot" :: held 2.140s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:54 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.550s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:54 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Deleted volume successfully.
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-072bca4b-0ca9-46f4-af10-9e8fd678ecdf tempest-VolumeDependencyTests-421519055 None] Lock "cinder-89d2f835-1127-4cba-a870-766cbce7409c-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Created reservations ['39139b90-4261-4534-9838-c54825bc9dec', '89f3fb84-daa3-4538-b87a-88d4e3976fc7', 'ce2e5f8b-736c-4079-a5dd-6532947d5c8e', '06f4cf3a-1174-41f1-8727-94db853e5b16'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:54 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Delete snapshot completed successfully.
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-0f768047-9e92-4e5a-b1d2-86e673888114 tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-deb82b3d-4d81-4842-8326-e80795558bcd-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:54 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 1073741824" returned: 0 in 0.604s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:54 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:54 devstack sudo[91036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40
Apr 13 18:50:54 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:55 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40" returned: 0 in 0.424s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'} {{(pid=82517) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e293af22-c8a4-4fcf-ac88-27bf34f41b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77cf8513-7d07-4b08-a544-4e6da19d6d40', 'volume_size': 1}' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864687e5-3236-4d03-8bfb-e641a35b681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 18:50:55 devstack cinder-volume[82517]: INFO cinder.volume.flows.manager.create_volume [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Volume volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 (77cf8513-7d07-4b08-a544-4e6da19d6d40): created successfully
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864687e5-3236-4d03-8bfb-e641a35b681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82517) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Flow 'volume_create_manager' (43b56c2f-ef5d-45cc-94f0-8107cf39a7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82517) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 18:50:55 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-a88d39e7-1c3b-4963-ab52-f3efef434d30 tempest-CinderUnicodeTest-2123915590 None] Created volume successfully.
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "cinder-fd48d040-894a-44ac-b579-58192c6d1266-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-fd48d040-894a-44ac-b579-58192c6d1266-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "cinder-quobyte-fd48d040-894a-44ac-b579-58192c6d1266" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-fd48d040-894a-44ac-b579-58192c6d1266" acquired by "delete_volume" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf6ea30-7d88-4046-83f9-d56a24d7c085]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:55 devstack sudo[91039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266
Apr 13 18:50:55 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:55 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266" returned: 0 in 0.450s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:55 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:55 devstack sudo[91044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266
Apr 13 18:50:55 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:INSERT=64,cinder:UPDATE=307,cinder:SELECT=213,cinder:DELETE=18 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=168,cinder:INSERT=64,cinder:UPDATE=237,cinder:DELETE=32 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:56 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-fd48d040-894a-44ac-b579-58192c6d1266" returned: 0 in 0.461s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Creating offline snapshot 3f0d0918-3d54-4023-83fe-589cded0c6cf of volume 77cf8513-7d07-4b08-a544-4e6da19d6d40 {{(pid=82517) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-fd48d040-894a-44ac-b579-58192c6d1266" released by "delete_volume" :: held 0.949s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[089c4eeb-3197-4645-92cd-3a6b0e20eae1]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Created reservations ['18d5f979-92c1-40ae-af31-f89d53fa0217', 'af5cae2d-c421-44a9-8b44-f8ba12146026', 'cd3bd6d1-ba9d-47f2-8de1-2a5c330bd512', '44f90390-9b7d-4bc6-8260-da1edd4093ff'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:56 devstack sudo[91047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:56 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:56 devstack sudo[91049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:56 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "cinder-c5f35c9b-d5e7-4c32-a767-ad920167e9da-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-c5f35c9b-d5e7-4c32-a767-ad920167e9da-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "cinder-quobyte-c5f35c9b-d5e7-4c32-a767-ad920167e9da" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-c5f35c9b-d5e7-4c32-a767-ad920167e9da" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4dead6-9bcc-4ec3-b480-3eaa1ecacdc0]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:56 devstack sudo[91051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da
Apr 13 18:50:56 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:56 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40" returned: 0 in 0.480s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf 1G {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:56 devstack sudo[91057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf 1G
Apr 13 18:50:56 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:56 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.436s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:56 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Deleted volume successfully.
Apr 13 18:50:56 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-92c07ec4-be6d-4737-a2ea-6d4276558f3c tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-fd48d040-894a-44ac-b579-58192c6d1266-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:57 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da" returned: 0 in 0.471s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:57 devstack sudo[91062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da
Apr 13 18:50:57 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:57 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf 1G" returned: 0 in 0.487s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:57 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf
Apr 13 18:50:57 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:57 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-c5f35c9b-d5e7-4c32-a767-ad920167e9da" returned: 0 in 0.440s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-quobyte-c5f35c9b-d5e7-4c32-a767-ad920167e9da" released by "delete_volume" :: held 0.931s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Created reservations ['e5ef3968-199f-45dd-a465-75319ba6edb0', 'cd0defec-4d4e-47f5-a3e1-b15d829e3d08', '12a03a16-eb5c-4656-ab1c-479c95969d63', 'e7d3f91b-148c-404d-8b10-14205820abfe'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:57 devstack sudo[91070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:50:57 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:57 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 -F qcow2 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf" returned: 0 in 0.441s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:57 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf is being set with open permissions: ugo+rw
Apr 13 18:50:57 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:57 devstack sudo[91075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf
Apr 13 18:50:57 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:58 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.420s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:58 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:50:58 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Deleted volume successfully.
Apr 13 18:50:58 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-4dca9a36-109b-4af6-b9a3-d644f8c5124e tempest-SnapshotDependencyTests-627672191 None] Lock "cinder-c5f35c9b-d5e7-4c32-a767-ad920167e9da-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:50:58 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf" returned: 0 in 0.464s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:58 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.info
Apr 13 18:50:58 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:58 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.info" returned: 0 in 0.476s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:58 devstack cinder-volume[82517]: WARNING cinder.volume.drivers.remotefs [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.info is being set with open permissions: ugo+rw
Apr 13 18:50:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.info {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:58 devstack sudo[91083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.info
Apr 13 18:50:58 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:50:59 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.info" returned: 0 in 0.458s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.882s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:50:59 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e13b00fb-69a6-451c-8c46-2f35865fb4b4 tempest-CinderUnicodeTest-2123915590 None] Create snapshot completed successfully
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "cinder-3f0d0918-3d54-4023-83fe-589cded0c6cf-delete_snapshot" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-3f0d0918-3d54-4023-83fe-589cded0c6cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "cinder-quobyte-77cf8513-7d07-4b08-a544-4e6da19d6d40" by "delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-quobyte-77cf8513-7d07-4b08-a544-4e6da19d6d40" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "cinder-quobyte-3f0d0918-3d54-4023-83fe-589cded0c6cf" by "_delete_snapshot" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-quobyte-3f0d0918-3d54-4023-83fe-589cded0c6cf" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Deleting offline snapshot 3f0d0918-3d54-4023-83fe-589cded0c6cf of volume 77cf8513-7d07-4b08-a544-4e6da19d6d40 {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] snapshot_file for this snap is: volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf {{(pid=82517) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee53af-6212-4c1b-9e74-1a40a3d3d74d]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:50:59 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:50:59 devstack sudo[91086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf
Apr 13 18:50:59 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:00 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf" returned: 0 in 0.551s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.remotefs [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77cf8513-7d07-4b08-a544-4e6da19d6d40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82517) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[7605f748-8f4a-44fe-9772-b17bcbed2d21]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:00 devstack sudo[91092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40
Apr 13 18:51:00 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:00 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40" returned: 0 in 0.522s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:00 devstack sudo[91097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf
Apr 13 18:51:00 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo_service.periodic_task [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82517) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:51:00 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:00 devstack sudo[91099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:51:00 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:01 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf" returned: 0 in 0.529s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:01 devstack sudo[91105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf
Apr 13 18:51:01 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:01 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.479s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:01 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-bd0329f8-1dc0-42ec-855e-6131cea9aea8 None None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:51:01 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:01 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40.3f0d0918-3d54-4023-83fe-589cded0c6cf" returned: 0 in 0.411s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-quobyte-3f0d0918-3d54-4023-83fe-589cded0c6cf" released by "_delete_snapshot" :: held 2.069s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:51:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-quobyte-77cf8513-7d07-4b08-a544-4e6da19d6d40" released by "delete_snapshot" :: held 2.084s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:51:01 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Created reservations ['9231169d-619f-4d66-abe8-8fea9a9a8cf1', '92f35d4f-9f97-42f2-864e-66082b099644', '3af85c40-7969-4d21-af00-987cd03e8675', '3c0ae76f-127c-4c27-9c53-f8c5c9b5b6fe'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:51:01 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Delete snapshot completed successfully.
Apr 13 18:51:01 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-d26c72a1-fec2-4a0c-bdc4-6c8c4c25e35b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-3f0d0918-3d54-4023-83fe-589cded0c6cf-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:51:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "cinder-77cf8513-7d07-4b08-a544-4e6da19d6d40-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:51:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-77cf8513-7d07-4b08-a544-4e6da19d6d40-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:51:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "cinder-quobyte-77cf8513-7d07-4b08-a544-4e6da19d6d40" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:51:02 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-quobyte-77cf8513-7d07-4b08-a544-4e6da19d6d40" acquired by "delete_volume" :: waited 0.007s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:51:02 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c040a2-c8a3-4dae-9b9e-a831a4153460]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:51:02 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:02 devstack sudo[91109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40
Apr 13 18:51:02 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:03 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40" returned: 0 in 0.549s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:03 devstack sudo[91115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40
Apr 13 18:51:03 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:03 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-77cf8513-7d07-4b08-a544-4e6da19d6d40" returned: 0 in 0.426s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-quobyte-77cf8513-7d07-4b08-a544-4e6da19d6d40" released by "delete_volume" :: held 1.011s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Created reservations ['66da60c5-3e4b-4167-b6e8-3d396c4fe154', 'b29301b9-f0d2-4cb4-bfcb-8dc8796f0f2b', '6d83f76a-6b37-4599-afda-70f89c9a5098', '6dd52687-d96b-4f5c-824e-d7b2ed772cc6'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:51:03 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:03 devstack sudo[91119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:51:03 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:04 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.460s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:04 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:51:04 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Deleted volume successfully.
Apr 13 18:51:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-e7480fa6-35dc-4e47-8f66-0c0df208df2b tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-77cf8513-7d07-4b08-a544-4e6da19d6d40-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:51:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "cinder-5978cb22-7652-480d-8ed0-a0c1d14d63f4-delete_volume" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:51:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-5978cb22-7652-480d-8ed0-a0c1d14d63f4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:51:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "cinder-quobyte-5978cb22-7652-480d-8ed0-a0c1d14d63f4" by "delete_volume" {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 18:51:04 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-quobyte-5978cb22-7652-480d-8ed0-a0c1d14d63f4" acquired by "delete_volume" :: waited 0.014s {{(pid=82517) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 18:51:04 devstack cinder-volume[82517]: DEBUG oslo.privsep.daemon [-] privsep: reply[e166ba02-4608-4870-84e6-fb5b6d77e38e]: (4, 'qcow2') {{(pid=83495) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 18:51:04 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:04 devstack sudo[91122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4
Apr 13 18:51:04 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:05 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4" returned: 0 in 0.461s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4 {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:05 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4
Apr 13 18:51:05 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:05 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded/volume-5978cb22-7652-480d-8ed0-a0c1d14d63f4" returned: 0 in 0.406s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-quobyte-5978cb22-7652-480d-8ed0-a0c1d14d63f4" released by "delete_volume" :: held 0.888s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG cinder.quota [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Created reservations ['c6d0f7bd-ae14-41c8-8052-ff7694ae88a5', 'ad69c922-36d0-4c57-a0ba-ec351b350486', '8b3e898c-a543-47ee-b35f-5c5adf352e87', '7514a206-5088-4151-897f-476c38301eba'] {{(pid=82517) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f': None} {{(pid=82517) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG cinder.volume.drivers.quobyte [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-50d3909f-75ee-4de7-8ce9-f2d51c98223f'] {{(pid=82517) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82517) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 18:51:05 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 18:51:05 devstack sudo[91130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded
Apr 13 18:51:05 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 18:51:06 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root
Apr 13 18:51:06 devstack cinder-volume[82517]: DEBUG oslo_concurrency.processutils [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/132f51d8f12e4531a41621d876ce6ded" returned: 0 in 0.435s {{(pid=82517) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 18:51:06 devstack cinder-volume[82517]: DEBUG cinder.manager [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Notifying Schedulers of capabilities ... {{(pid=82517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 18:51:06 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Deleted volume successfully.
Apr 13 18:51:06 devstack cinder-volume[82517]: DEBUG cinder.coordination [None req-3479970d-d3b6-4cb6-8086-97cf49b2f12a tempest-CinderUnicodeTest-2123915590 None] Lock "cinder-5978cb22-7652-480d-8ed0-a0c1d14d63f4-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=82517) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 18:51:15 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=33,cinder:INSERT=10,cinder:UPDATE=53,cinder:DELETE=3 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 18:51:16 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=23,cinder:INSERT=11,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}